[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:00 dist-test-slave-9dgf krb5kdc[10120](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:00 dist-test-slave-9dgf krb5kdc[10120](info): set up 2 sockets
Jun 19 04:39:00 dist-test-slave-9dgf krb5kdc[10120](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260619 04:39:01.951414 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.006s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:02 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:02.135243 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37077
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:37077
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:02.462594 10133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:02.462903 10133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:02.462994 10133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:02.470139 10133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:02.470307 10133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:02.470391 10133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:02.470451 10133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:02.470496 10133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:02.480674 10133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:37077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:02.481979 10133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:02.483352 10133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:02.496217 10138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:02.496244 10139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:02.496160 10141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:02.496665 10133 server_base.cc:1034] running on GCE node
I20260619 04:39:02.497543 10133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:02.499195 10133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:02.500501 10133 hybrid_clock.cc:648] HybridClock initialized: now 1781843942500423 us; error 58 us; skew 500 ppm
I20260619 04:39:02.500927 10133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:02 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843942, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:02.504212 10133 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:02.505838 10133 webserver.cc:460] Webserver started at http://127.9.224.126:41853/ using document root <none> and password file <none>
I20260619 04:39:02.506762 10133 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:02.506915 10133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:02.507265 10133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:02.510398 10133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "e75c8ac0ba4a42a8928e6712a8735518"
format_stamp: "Formatted at 2026-06-19 04:39:02 on dist-test-slave-9dgf"
server_key: "888dcef6f8abc6de8ee238be185c8406"
server_key_iv: "1f29894cb607a84c1b81159c133f960d"
server_key_version: "encryptionkey@0"
I20260619 04:39:02.511265 10133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "e75c8ac0ba4a42a8928e6712a8735518"
format_stamp: "Formatted at 2026-06-19 04:39:02 on dist-test-slave-9dgf"
server_key: "888dcef6f8abc6de8ee238be185c8406"
server_key_iv: "1f29894cb607a84c1b81159c133f960d"
server_key_version: "encryptionkey@0"
I20260619 04:39:02.516739 10133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:39:02.520502 10148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:02.521970 10133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:02.522202 10133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "e75c8ac0ba4a42a8928e6712a8735518"
format_stamp: "Formatted at 2026-06-19 04:39:02 on dist-test-slave-9dgf"
server_key: "888dcef6f8abc6de8ee238be185c8406"
server_key_iv: "1f29894cb607a84c1b81159c133f960d"
server_key_version: "encryptionkey@0"
I20260619 04:39:02.522536 10133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:02.540686 10133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:02.545099 10133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:02.545410 10133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:02.565016 10133 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:37077
I20260619 04:39:02.565070 10199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:37077 every 8 connection(s)
I20260619 04:39:02.566524 10133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:02.570634 10200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:02.572433 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10133
I20260619 04:39:02.572748 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:02.574651 10113 external_mini_cluster.cc:1428] Setting key a2a7e4dcd281ecf4a4c812943276ae2c
I20260619 04:39:02.581588 10200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518: Bootstrap starting.
I20260619 04:39:02.584525 10200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:02.585554 10200 log.cc:824] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:02.588536 10200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518: No bootstrap required, opened a new log
I20260619 04:39:02.598526 10200 raft_consensus.cc:348] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75c8ac0ba4a42a8928e6712a8735518" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37077 } }
I20260619 04:39:02.598922 10200 raft_consensus.cc:374] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:02.599078 10200 raft_consensus.cc:729] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e75c8ac0ba4a42a8928e6712a8735518, State: Initialized, Role: FOLLOWER
I20260619 04:39:02.599852 10200 consensus_queue.cc:260] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75c8ac0ba4a42a8928e6712a8735518" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37077 } }
I20260619 04:39:02.600139 10200 raft_consensus.cc:388] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:02.600286 10200 raft_consensus.cc:482] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:02.600486 10200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:02.602950 10200 raft_consensus.cc:504] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75c8ac0ba4a42a8928e6712a8735518" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37077 } }
I20260619 04:39:02.603518 10200 leader_election.cc:302] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e75c8ac0ba4a42a8928e6712a8735518; no voters:
I20260619 04:39:02.604185 10200 leader_election.cc:288] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:02.604419 10205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:02.605593 10205 raft_consensus.cc:686] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [term 1 LEADER]: Becoming Leader. State: Replica: e75c8ac0ba4a42a8928e6712a8735518, State: Running, Role: LEADER
Jun 19 04:39:02 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:02.606308 10205 consensus_queue.cc:237] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75c8ac0ba4a42a8928e6712a8735518" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37077 } }
I20260619 04:39:02.606681 10200 sys_catalog.cc:564] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:02.611016 10207 sys_catalog.cc:455] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e75c8ac0ba4a42a8928e6712a8735518. Latest consensus state: current_term: 1 leader_uuid: "e75c8ac0ba4a42a8928e6712a8735518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75c8ac0ba4a42a8928e6712a8735518" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37077 } } }
I20260619 04:39:02.611166 10206 sys_catalog.cc:455] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e75c8ac0ba4a42a8928e6712a8735518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75c8ac0ba4a42a8928e6712a8735518" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37077 } } }
I20260619 04:39:02.612182 10206 sys_catalog.cc:458] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:02.612491 10207 sys_catalog.cc:458] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:02.626183 10213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:02.626484 10202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:02.578433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.9.224.126:37077)
0619 04:39:02.579478 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:02.579495 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:02.580783 (+ 1288us) server_negotiation.cc:407] Connection header received
0619 04:39:02.590569 (+ 9786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:02.590601 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:02.591166 (+ 565us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:02.591655 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:02.594677 (+ 3022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:02.597098 (+ 2421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:02.599390 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:02.600492 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:02.600703 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:02.608475 (+ 7772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:02.608492 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:02.608521 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:02.608595 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:02.616573 (+ 7978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:02.618269 (+ 1696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:02.618283 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:02.618296 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:02.618603 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:02.619430 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:02.619438 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:02.619444 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:02.620419 (+ 975us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:02.622603 (+ 2184us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:02.623081 (+ 478us) server_negotiation.cc:299] Negotiation successful
0619 04:39:02.624609 (+ 1528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":492,"threads_started":1}
I20260619 04:39:02.633268 10213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:02.643855 10213 catalog_manager.cc:1347] Generated new cluster ID: 02ba44bdb6954b66a546b3e6cd30c279
I20260619 04:39:02.644017 10213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:02.656446 10213 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:02.657817 10213 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:02.673262 10213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e75c8ac0ba4a42a8928e6712a8735518: Generated new TSK 0
I20260619 04:39:02.674196 10213 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:02.727324 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37077
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:03.064145 10226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:03.064507 10226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:03.064682 10226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:03.071949 10226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:03.072113 10226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:03.072305 10226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:03.082134 10226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:03.083597 10226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:03.084968 10226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:03.098297 10231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:03.098244 10232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:03.098737 10234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:03.099524 10226 server_base.cc:1034] running on GCE node
I20260619 04:39:03.100133 10226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:03.101130 10226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:03.102360 10226 hybrid_clock.cc:648] HybridClock initialized: now 1781843943102302 us; error 35 us; skew 500 ppm
I20260619 04:39:03.102754 10226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:03 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843943, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:03.106086 10226 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:03.107797 10226 webserver.cc:460] Webserver started at http://127.9.224.65:46235/ using document root <none> and password file <none>
I20260619 04:39:03.108512 10226 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:03.108654 10226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:03.108982 10226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:03.112007 10226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "edf13dad8ae94d199b13c68122dd5dc8"
format_stamp: "Formatted at 2026-06-19 04:39:03 on dist-test-slave-9dgf"
server_key: "26fc8e83d425742d22d9a5596a02b12c"
server_key_iv: "1bf580a2b3dd416886f5c1b9c682db1f"
server_key_version: "encryptionkey@0"
I20260619 04:39:03.112795 10226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "edf13dad8ae94d199b13c68122dd5dc8"
format_stamp: "Formatted at 2026-06-19 04:39:03 on dist-test-slave-9dgf"
server_key: "26fc8e83d425742d22d9a5596a02b12c"
server_key_iv: "1bf580a2b3dd416886f5c1b9c682db1f"
server_key_version: "encryptionkey@0"
I20260619 04:39:03.118216 10226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:39:03.121759 10241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:03.123157 10226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 04:39:03.123334 10226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "edf13dad8ae94d199b13c68122dd5dc8"
format_stamp: "Formatted at 2026-06-19 04:39:03 on dist-test-slave-9dgf"
server_key: "26fc8e83d425742d22d9a5596a02b12c"
server_key_iv: "1bf580a2b3dd416886f5c1b9c682db1f"
server_key_version: "encryptionkey@0"
I20260619 04:39:03.123595 10226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:03.150499 10226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:03.154783 10226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:03.155086 10226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:03.156080 10226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:03.157400 10226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:03.157505 10226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:03.157652 10226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:03.157724 10226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:03.191816 10226 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:41449
I20260619 04:39:03.191902 10353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:41449 every 8 connection(s)
I20260619 04:39:03.193128 10226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:03.196602 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10226
I20260619 04:39:03.196859 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:03.197664 10113 external_mini_cluster.cc:1428] Setting key 0cd6a4a9fe0f5e0708f38f7340289b06
Jun 19 04:39:03 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843943, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:03.215327 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:03.195732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:60055 (local address 127.9.224.126:37077)
0619 04:39:03.196193 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:03.196199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:03.197398 (+ 1199us) server_negotiation.cc:407] Connection header received
0619 04:39:03.199758 (+ 2360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:03.199763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:03.199850 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:03.199961 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:03.201487 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.202198 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.203861 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.204585 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.204729 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:03.208696 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:03.208702 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:03.208705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:03.208738 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:03.211792 (+ 3054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:03.212619 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:03.212628 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:03.212637 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:03.212766 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:03.213239 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:03.213247 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:03.213250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:03.213539 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:03.213714 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:03.214652 (+ 938us) server_negotiation.cc:299] Negotiation successful
0619 04:39:03.214898 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":214,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:39:03.216599 10357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:03.196343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37077 (local address 127.9.224.65:60055)
0619 04:39:03.197208 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:03.197258 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:03.199446 (+ 2188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:03.200210 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:03.200219 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:03.200737 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:03.201319 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:03.201336 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.202401 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.202410 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:03.203710 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:03.203722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.204824 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.204829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:03.205050 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:03.205763 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:03.205786 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:03.208452 (+ 2666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:03.211962 (+ 3510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:03.211972 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:03.211991 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:03.212470 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:03.212889 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:03.212895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:03.212900 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:03.213116 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:03.213706 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:03.213715 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:03.214168 (+ 453us) client_negotiation.cc:769] Sending connection context
0619 04:39:03.214543 (+ 375us) client_negotiation.cc:240] Negotiation successful
0619 04:39:03.215216 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":341,"threads_started":1}
I20260619 04:39:03.218289 10354 heartbeater.cc:347] Connected to a master server at 127.9.224.126:37077
I20260619 04:39:03.218652 10354 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:03.219525 10354 heartbeater.cc:511] Master 127.9.224.126:37077 requested a full tablet report, sending...
I20260619 04:39:03.221779 10165 ts_manager.cc:194] Registered new tserver with Master: edf13dad8ae94d199b13c68122dd5dc8 (127.9.224.65:41449)
I20260619 04:39:03.224035 10165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:60055
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:03.241917 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37077
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:03.563935 10360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:03.564296 10360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:03.564502 10360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:03.572150 10360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:03.572314 10360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:03.572522 10360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:03.582567 10360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:03.583832 10360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:03.585187 10360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:03.598837 10365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:03.598799 10366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:03.598887 10368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:03.599828 10360 server_base.cc:1034] running on GCE node
I20260619 04:39:03.600461 10360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:03.601461 10360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:03.602685 10360 hybrid_clock.cc:648] HybridClock initialized: now 1781843943602635 us; error 48 us; skew 500 ppm
I20260619 04:39:03.603008 10360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:03 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843943, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:03.606341 10360 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:03.608065 10360 webserver.cc:460] Webserver started at http://127.9.224.66:43977/ using document root <none> and password file <none>
I20260619 04:39:03.608760 10360 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:03.608863 10360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:03.609153 10360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:03.612334 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "554b7f0ad8a348dfa49328572f77dc54"
format_stamp: "Formatted at 2026-06-19 04:39:03 on dist-test-slave-9dgf"
server_key: "671c4ef714d1c6a303a1140ef373e787"
server_key_iv: "cf45259763df408988b645b36fb1190b"
server_key_version: "encryptionkey@0"
I20260619 04:39:03.613144 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "554b7f0ad8a348dfa49328572f77dc54"
format_stamp: "Formatted at 2026-06-19 04:39:03 on dist-test-slave-9dgf"
server_key: "671c4ef714d1c6a303a1140ef373e787"
server_key_iv: "cf45259763df408988b645b36fb1190b"
server_key_version: "encryptionkey@0"
I20260619 04:39:03.618784 10360 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:39:03.622401 10375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:03.623817 10360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:03.623952 10360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "554b7f0ad8a348dfa49328572f77dc54"
format_stamp: "Formatted at 2026-06-19 04:39:03 on dist-test-slave-9dgf"
server_key: "671c4ef714d1c6a303a1140ef373e787"
server_key_iv: "cf45259763df408988b645b36fb1190b"
server_key_version: "encryptionkey@0"
I20260619 04:39:03.624133 10360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:03.643815 10360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:03.648531 10360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:03.648861 10360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:03.649892 10360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:03.651330 10360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:03.651453 10360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:03.651603 10360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:03.651682 10360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:03.685909 10360 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:38777
I20260619 04:39:03.685958 10487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:38777 every 8 connection(s)
I20260619 04:39:03.687269 10360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:03.689605 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10360
I20260619 04:39:03.689832 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:03.690410 10113 external_mini_cluster.cc:1428] Setting key 4d3664dd3efbec89298b3e24d959cdad
Jun 19 04:39:03 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843943, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
I20260619 04:39:03.709933 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:03.690022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:41071 (local address 127.9.224.126:37077)
0619 04:39:03.690198 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:03.690203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:03.691842 (+ 1639us) server_negotiation.cc:407] Connection header received
0619 04:39:03.694053 (+ 2211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:03.694058 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:03.694149 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:03.694273 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:03.695864 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.696834 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.699207 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.699627 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.699723 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:03.703848 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:03.703853 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:03.703857 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:03.703887 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:03.706690 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:03.707527 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:03.707532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:03.707534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:03.707733 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:03.708127 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:03.708131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:03.708133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:03.708475 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:03.708629 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:03.709365 (+ 736us) server_negotiation.cc:299] Negotiation successful
0619 04:39:03.709589 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 04:39:03.711005 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:03.690715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37077 (local address 127.9.224.66:41071)
0619 04:39:03.691666 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:03.691723 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:03.693789 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:03.694532 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:03.694540 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:03.695130 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:03.695699 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:03.695716 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.697000 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.697004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:03.699061 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:03.699079 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:03.699860 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:03.699870 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:03.700193 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:03.700932 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:03.700964 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:03.703615 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:03.706858 (+ 3243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:03.706869 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:03.706887 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:03.707398 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:03.707832 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:03.707835 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:03.707838 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:03.708017 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:03.708618 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:03.708624 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:03.708938 (+ 314us) client_negotiation.cc:769] Sending connection context
0619 04:39:03.709267 (+ 329us) client_negotiation.cc:240] Negotiation successful
0619 04:39:03.709813 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":367,"threads_started":1}
I20260619 04:39:03.712502 10488 heartbeater.cc:347] Connected to a master server at 127.9.224.126:37077
I20260619 04:39:03.712852 10488 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:03.713629 10488 heartbeater.cc:511] Master 127.9.224.126:37077 requested a full tablet report, sending...
I20260619 04:39:03.715224 10165 ts_manager.cc:194] Registered new tserver with Master: 554b7f0ad8a348dfa49328572f77dc54 (127.9.224.66:38777)
I20260619 04:39:03.716063 10165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:41071
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:03.731822 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37077
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:04.057466 10493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:04.057812 10493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:04.058010 10493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:04.065459 10493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:04.065627 10493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:04.065835 10493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:04.076254 10493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:04.077636 10493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:04.079077 10493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:04.094743 10501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:04.094995 10498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:04.095539 10499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:04.096238 10493 server_base.cc:1034] running on GCE node
I20260619 04:39:04.096872 10493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:04.097935 10493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:04.099165 10493 hybrid_clock.cc:648] HybridClock initialized: now 1781843944099098 us; error 61 us; skew 500 ppm
I20260619 04:39:04.099495 10493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:04.102613 10493 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:04.104171 10493 webserver.cc:460] Webserver started at http://127.9.224.67:45313/ using document root <none> and password file <none>
I20260619 04:39:04.104869 10493 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:04.105015 10493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:04.105335 10493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:04.108817 10493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "ef269b58a8d94057b15378be9e438b75"
format_stamp: "Formatted at 2026-06-19 04:39:04 on dist-test-slave-9dgf"
server_key: "a37b7712853283c1a60c169b89960263"
server_key_iv: "22605c8f4eb75515cb414f2aec9d7c51"
server_key_version: "encryptionkey@0"
I20260619 04:39:04.109683 10493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "ef269b58a8d94057b15378be9e438b75"
format_stamp: "Formatted at 2026-06-19 04:39:04 on dist-test-slave-9dgf"
server_key: "a37b7712853283c1a60c169b89960263"
server_key_iv: "22605c8f4eb75515cb414f2aec9d7c51"
server_key_version: "encryptionkey@0"
I20260619 04:39:04.115047 10493 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:39:04.118615 10508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:04.119946 10493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:04.120133 10493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "ef269b58a8d94057b15378be9e438b75"
format_stamp: "Formatted at 2026-06-19 04:39:04 on dist-test-slave-9dgf"
server_key: "a37b7712853283c1a60c169b89960263"
server_key_iv: "22605c8f4eb75515cb414f2aec9d7c51"
server_key_version: "encryptionkey@0"
I20260619 04:39:04.120332 10493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:04.143226 10493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:04.147540 10493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:04.147853 10493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:04.148844 10493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:04.150298 10493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:04.150408 10493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:04.150568 10493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:04.150643 10493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:04.184911 10493 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:46211
I20260619 04:39:04.184949 10620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:46211 every 8 connection(s)
I20260619 04:39:04.186196 10493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:04.189195 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10493
I20260619 04:39:04.189405 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:04.189846 10113 external_mini_cluster.cc:1428] Setting key 89515d38af18a9eb8c263cb1a3bc2849
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:04.207290 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.189021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:57755 (local address 127.9.224.126:37077)
0619 04:39:04.189277 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:04.189284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:04.190663 (+ 1379us) server_negotiation.cc:407] Connection header received
0619 04:39:04.193068 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:04.193074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:04.193163 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:04.193276 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:04.195015 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.195774 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.197346 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.197761 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.197893 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.201296 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:04.201301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:04.201304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:04.201336 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:04.203988 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.204756 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.204761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.204764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.204905 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.205361 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.205366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.205368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.205653 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:04.205817 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:04.206695 (+ 878us) server_negotiation.cc:299] Negotiation successful
0619 04:39:04.206929 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260619 04:39:04.208385 10623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.189626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37077 (local address 127.9.224.67:57755)
0619 04:39:04.190483 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:04.190540 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:04.192793 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:04.193566 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:04.193578 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:04.194213 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:04.194844 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:04.194866 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.195930 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.195935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:04.197177 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:04.197189 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.197996 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.198003 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:04.198308 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.198933 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:04.198955 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:04.201077 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:04.204155 (+ 3078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:04.204164 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:04.204182 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:04.204619 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:04.205020 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:04.205025 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:04.205029 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:04.205231 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:04.205789 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:04.205797 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:04.206169 (+ 372us) client_negotiation.cc:769] Sending connection context
0619 04:39:04.206560 (+ 391us) client_negotiation.cc:240] Negotiation successful
0619 04:39:04.207167 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":362,"threads_started":1}
I20260619 04:39:04.209908 10621 heartbeater.cc:347] Connected to a master server at 127.9.224.126:37077
I20260619 04:39:04.210342 10621 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:04.211104 10621 heartbeater.cc:511] Master 127.9.224.126:37077 requested a full tablet report, sending...
I20260619 04:39:04.212651 10165 ts_manager.cc:194] Registered new tserver with Master: ef269b58a8d94057b15378be9e438b75 (127.9.224.67:46211)
I20260619 04:39:04.213485 10165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:57755
I20260619 04:39:04.218815 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:39:04.228057 10354 heartbeater.cc:503] Master 127.9.224.126:37077 was elected leader, sending a full tablet report...
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:04.264648 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.248973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40814 (local address 127.9.224.65:41449)
0619 04:39:04.249977 (+ 1004us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:04.249984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:04.250010 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:39:04.250097 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:04.250103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:04.250387 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:04.250539 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:04.252016 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.253029 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.254548 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.255116 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.255213 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.259381 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:04.259393 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:04.259408 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:04.259446 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:04.262188 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.262875 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.262882 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.262884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.263009 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.263353 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.263356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.263357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.263682 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:04.263899 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:04.264159 (+ 260us) server_negotiation.cc:299] Negotiation successful
0619 04:39:04.264355 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":842,"thread_start_us":681,"threads_started":1}
W20260619 04:39:04.265903 10269 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40814
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:04.310956 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.297018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40818 (local address 127.9.224.65:41449)
0619 04:39:04.297276 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:04.297283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:04.297576 (+ 293us) server_negotiation.cc:407] Connection header received
0619 04:39:04.297789 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:04.297794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:04.297885 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:04.297998 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:04.299385 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.300075 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.301342 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.301771 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.301906 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.305789 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:04.305794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:04.305798 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:04.305831 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:04.308597 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.309263 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.309267 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.309269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.309391 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.309716 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.309720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.309722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.309968 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:04.310139 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:04.310489 (+ 350us) server_negotiation.cc:299] Negotiation successful
0619 04:39:04.310663 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260619 04:39:04.312516 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10226
I20260619 04:39:04.325109 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.313594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40826 (local address 127.9.224.65:41449)
0619 04:39:04.313744 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:04.313748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:04.314068 (+ 320us) server_negotiation.cc:407] Connection header received
0619 04:39:04.314187 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:04.314190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:04.314295 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:04.314369 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:04.315489 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.316165 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.317442 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.317909 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.318010 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.320166 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:04.320171 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:04.320174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:04.320201 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:04.322728 (+ 2527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.323299 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.323302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.323304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.323447 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.323797 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.323801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.323803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.324064 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:04.324259 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:04.324520 (+ 261us) server_negotiation.cc:299] Negotiation successful
0619 04:39:04.324726 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260619 04:39:04.325896 10349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:04.410020 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10226
I20260619 04:39:04.426769 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10360
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:04.442430 10635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.427709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38950 (local address 127.9.224.66:38777)
0619 04:39:04.428361 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:04.428368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:04.428394 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:39:04.428460 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:04.428467 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:04.428745 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:04.428933 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:04.430036 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.431136 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.432408 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.432948 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.433043 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.437011 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:04.437021 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:04.437035 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:04.437067 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:04.439957 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.440547 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.440554 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.440556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.440666 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.441008 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.441012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.441014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.441316 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:04.441537 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:04.441860 (+ 323us) server_negotiation.cc:299] Negotiation successful
0619 04:39:04.442040 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":373,"threads_started":1}
I20260619 04:39:04.443665 10483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:04.530722 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10360
I20260619 04:39:04.546559 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10493
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:04.563086 10637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:04.547586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56326 (local address 127.9.224.67:46211)
0619 04:39:04.548223 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:04.548229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:04.548259 (+ 30us) server_negotiation.cc:407] Connection header received
0619 04:39:04.548316 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:04.548322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:04.548524 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:04.548647 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:04.549881 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.551078 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.552328 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:04.552878 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:04.552972 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:04.557352 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:04.557364 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:04.557380 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:04.557461 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:04.560373 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.561006 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.561022 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.561024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.561145 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:04.561442 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:04.561445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:04.561447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:04.561798 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:04.562055 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:04.562462 (+ 407us) server_negotiation.cc:299] Negotiation successful
0619 04:39:04.562669 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":324,"threads_started":1}
I20260619 04:39:04.564476 10616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:04.650084 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10493
I20260619 04:39:04.666973 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10133
I20260619 04:39:04.668195 10195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:04.774984 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10133
2026-06-19T04:39:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3921 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10642](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10642](info): set up 2 sockets
Jun 19 04:39:04 dist-test-slave-9dgf krb5kdc[10642](info): commencing operation
krb5kdc: starting...
W20260619 04:39:05.854346 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:05 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:06.035687 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38583
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:38583
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:06.352751 10655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:06.353035 10655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:06.353196 10655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:06.360426 10655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:06.360533 10655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:06.360627 10655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:06.360720 10655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:06.360790 10655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:06.370620 10655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:38583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:06.371973 10655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:06.373271 10655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:06.385258 10661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:06.385447 10663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:06.385905 10660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:06.386077 10655 server_base.cc:1034] running on GCE node
I20260619 04:39:06.387068 10655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:06.388509 10655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:06.389761 10655 hybrid_clock.cc:648] HybridClock initialized: now 1781843946389703 us; error 66 us; skew 500 ppm
I20260619 04:39:06.390131 10655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:06 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843946, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:06.398631 10655 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:06.400223 10655 webserver.cc:460] Webserver started at http://127.9.224.126:36525/ using document root <none> and password file <none>
I20260619 04:39:06.400956 10655 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:06.401106 10655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:06.401427 10655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:06.404474 10655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "4c4ce464e9b947e18a4cc6edb270546c"
format_stamp: "Formatted at 2026-06-19 04:39:06 on dist-test-slave-9dgf"
server_key: "2b5ab41264371c9be3f38855c5bf1047"
server_key_iv: "e9432f533b6c255f50cafcf7bf2e059f"
server_key_version: "encryptionkey@0"
I20260619 04:39:06.405226 10655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "4c4ce464e9b947e18a4cc6edb270546c"
format_stamp: "Formatted at 2026-06-19 04:39:06 on dist-test-slave-9dgf"
server_key: "2b5ab41264371c9be3f38855c5bf1047"
server_key_iv: "e9432f533b6c255f50cafcf7bf2e059f"
server_key_version: "encryptionkey@0"
I20260619 04:39:06.410442 10655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:39:06.413857 10670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:06.415371 10655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:06.415556 10655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "4c4ce464e9b947e18a4cc6edb270546c"
format_stamp: "Formatted at 2026-06-19 04:39:06 on dist-test-slave-9dgf"
server_key: "2b5ab41264371c9be3f38855c5bf1047"
server_key_iv: "e9432f533b6c255f50cafcf7bf2e059f"
server_key_version: "encryptionkey@0"
I20260619 04:39:06.415776 10655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:06.427825 10655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:06.432060 10655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:06.432353 10655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:06.450505 10655 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:38583
I20260619 04:39:06.450513 10721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:38583 every 8 connection(s)
I20260619 04:39:06.451934 10655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:06.452804 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10655
I20260619 04:39:06.453049 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:06.453779 10113 external_mini_cluster.cc:1428] Setting key 01709e384e1d36b1c9d9a27fef953a6d
I20260619 04:39:06.456409 10722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 04:39:06 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:06.469504 10722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c: Bootstrap starting.
I20260619 04:39:06.472903 10722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:06.473906 10722 log.cc:824] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:06.476930 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:06.455758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37110 (local address 127.9.224.126:38583)
0619 04:39:06.456565 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:06.456584 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:06.456626 (+ 42us) server_negotiation.cc:407] Connection header received
0619 04:39:06.458354 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:06.458377 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:06.458746 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:06.459094 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:06.460945 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:06.462444 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:06.464192 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:06.464837 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:06.464990 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:06.469590 (+ 4600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:06.469598 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:06.469612 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:06.469673 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:06.472730 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:06.473469 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:06.473477 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:06.473483 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:06.473639 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:06.474024 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:06.474031 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:06.474034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:06.474823 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:06.475141 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:06.475542 (+ 401us) server_negotiation.cc:299] Negotiation successful
0619 04:39:06.475939 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":365,"threads_started":1}
I20260619 04:39:06.477088 10722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c: No bootstrap required, opened a new log
I20260619 04:39:06.485571 10722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4ce464e9b947e18a4cc6edb270546c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38583 } }
I20260619 04:39:06.485970 10722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:06.486079 10722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4ce464e9b947e18a4cc6edb270546c, State: Initialized, Role: FOLLOWER
I20260619 04:39:06.486728 10722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4ce464e9b947e18a4cc6edb270546c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38583 } }
I20260619 04:39:06.486974 10722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:06.487113 10722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:06.487296 10722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:06.489463 10722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4ce464e9b947e18a4cc6edb270546c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38583 } }
I20260619 04:39:06.489969 10722 leader_election.cc:302] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c4ce464e9b947e18a4cc6edb270546c; no voters:
I20260619 04:39:06.490978 10722 leader_election.cc:288] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:06.491166 10727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:06.491972 10727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [term 1 LEADER]: Becoming Leader. State: Replica: 4c4ce464e9b947e18a4cc6edb270546c, State: Running, Role: LEADER
I20260619 04:39:06.492496 10727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4ce464e9b947e18a4cc6edb270546c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38583 } }
I20260619 04:39:06.493075 10722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:06.495620 10729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c4ce464e9b947e18a4cc6edb270546c. Latest consensus state: current_term: 1 leader_uuid: "4c4ce464e9b947e18a4cc6edb270546c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4ce464e9b947e18a4cc6edb270546c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38583 } } }
I20260619 04:39:06.495594 10728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c4ce464e9b947e18a4cc6edb270546c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4ce464e9b947e18a4cc6edb270546c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38583 } } }
I20260619 04:39:06.496023 10729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:06.496045 10728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:06.498616 10732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:06.503764 10732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:06.514693 10732 catalog_manager.cc:1347] Generated new cluster ID: b6295077f4b54f84ae332b84bb4c17b5
I20260619 04:39:06.514820 10732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:06.525206 10732 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:06.526677 10732 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:06.537976 10732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c4ce464e9b947e18a4cc6edb270546c: Generated new TSK 0
I20260619 04:39:06.538903 10732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:06.589898 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38583
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:06.918931 10748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:06.919284 10748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:06.919448 10748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:06.926681 10748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:06.926839 10748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:06.927028 10748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:06.936847 10748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38583
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:06.938179 10748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:06.939829 10748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:06.952940 10756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:06.953022 10754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:06.952963 10753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:06.953825 10748 server_base.cc:1034] running on GCE node
I20260619 04:39:06.954530 10748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:06.955507 10748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:06.956702 10748 hybrid_clock.cc:648] HybridClock initialized: now 1781843946956637 us; error 60 us; skew 500 ppm
I20260619 04:39:06.957028 10748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:06 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843946, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:06.960320 10748 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:06.961766 10748 webserver.cc:460] Webserver started at http://127.9.224.65:42883/ using document root <none> and password file <none>
I20260619 04:39:06.962558 10748 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:06.962657 10748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:06.962910 10748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:06.965792 10748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "64f1cda99b494d63bb1e429e917065cb"
format_stamp: "Formatted at 2026-06-19 04:39:06 on dist-test-slave-9dgf"
server_key: "77ad740d025e2b26119ff4ed839d4980"
server_key_iv: "2453987056455b4bb5594ec900bf581a"
server_key_version: "encryptionkey@0"
I20260619 04:39:06.966616 10748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "64f1cda99b494d63bb1e429e917065cb"
format_stamp: "Formatted at 2026-06-19 04:39:06 on dist-test-slave-9dgf"
server_key: "77ad740d025e2b26119ff4ed839d4980"
server_key_iv: "2453987056455b4bb5594ec900bf581a"
server_key_version: "encryptionkey@0"
I20260619 04:39:06.971787 10748 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:39:06.975411 10763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:06.976848 10748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:06.977029 10748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "64f1cda99b494d63bb1e429e917065cb"
format_stamp: "Formatted at 2026-06-19 04:39:06 on dist-test-slave-9dgf"
server_key: "77ad740d025e2b26119ff4ed839d4980"
server_key_iv: "2453987056455b4bb5594ec900bf581a"
server_key_version: "encryptionkey@0"
I20260619 04:39:06.977203 10748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:07.007570 10748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:07.012235 10748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:07.012550 10748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:07.013586 10748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:07.015010 10748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:07.015121 10748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:07.015272 10748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:07.015362 10748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:07.049360 10748 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:41317
I20260619 04:39:07.049399 10875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:41317 every 8 connection(s)
I20260619 04:39:07.050758 10748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:07.060316 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10748
I20260619 04:39:07.060552 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:07.061189 10113 external_mini_cluster.cc:1428] Setting key 5d875e272874010c3bb5dec7a9b763aa
Jun 19 04:39:07 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843946, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:07.071772 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:07.053455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:35591 (local address 127.9.224.126:38583)
0619 04:39:07.053937 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:07.053941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:07.054910 (+ 969us) server_negotiation.cc:407] Connection header received
0619 04:39:07.056761 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:07.056768 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:07.056866 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:07.056989 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:07.058625 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.059398 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.061138 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.061602 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.061747 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:07.065725 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:07.065730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:07.065734 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:07.065766 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:07.068466 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:07.069327 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:07.069331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:07.069333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:07.069455 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:07.069910 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:07.069919 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:07.069921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:07.070180 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:07.070423 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:07.071159 (+ 736us) server_negotiation.cc:299] Negotiation successful
0619 04:39:07.071401 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":275,"threads_started":1}
I20260619 04:39:07.072836 10879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:07.053954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38583 (local address 127.9.224.65:35591)
0619 04:39:07.054717 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:07.054756 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:07.056480 (+ 1724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:07.057237 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:07.057246 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:07.057786 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:07.058445 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:07.058466 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.059580 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.059585 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:07.060953 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:07.060966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.061851 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.061861 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:07.062108 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:07.062866 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:07.062889 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:07.065480 (+ 2591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:07.068629 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:07.068638 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:07.068658 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:07.069166 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:07.069569 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:07.069574 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:07.069578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:07.069779 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:07.070396 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:07.070406 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:07.070771 (+ 365us) client_negotiation.cc:769] Sending connection context
0619 04:39:07.071068 (+ 297us) client_negotiation.cc:240] Negotiation successful
0619 04:39:07.071638 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":354,"threads_started":1}
I20260619 04:39:07.074630 10876 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38583
I20260619 04:39:07.074954 10876 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:07.075699 10876 heartbeater.cc:511] Master 127.9.224.126:38583 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:07.078220 10687 ts_manager.cc:194] Registered new tserver with Master: 64f1cda99b494d63bb1e429e917065cb (127.9.224.65:41317)
I20260619 04:39:07.079845 10687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:35591
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:07.103730 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38583
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:07.426745 10882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:07.427017 10882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:07.427202 10882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:07.434455 10882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:07.434584 10882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:07.434760 10882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:07.444851 10882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38583
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:07.446103 10882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:07.447431 10882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:07.462214 10887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:07.462215 10888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:07.462973 10882 server_base.cc:1034] running on GCE node
W20260619 04:39:07.462997 10890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:07.463722 10882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:07.464753 10882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:07.465975 10882 hybrid_clock.cc:648] HybridClock initialized: now 1781843947465929 us; error 44 us; skew 500 ppm
I20260619 04:39:07.466357 10882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:07 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843947, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:07.469475 10882 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:07.471057 10882 webserver.cc:460] Webserver started at http://127.9.224.66:42865/ using document root <none> and password file <none>
I20260619 04:39:07.471709 10882 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:07.471805 10882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:07.472055 10882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:07.475005 10882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "871cec9c657247f296dae19bbf48df50"
format_stamp: "Formatted at 2026-06-19 04:39:07 on dist-test-slave-9dgf"
server_key: "6161da8a716494af9a8d3ba77f26133a"
server_key_iv: "dcd49badd393a6ee34a8af26577d4dd4"
server_key_version: "encryptionkey@0"
I20260619 04:39:07.475725 10882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "871cec9c657247f296dae19bbf48df50"
format_stamp: "Formatted at 2026-06-19 04:39:07 on dist-test-slave-9dgf"
server_key: "6161da8a716494af9a8d3ba77f26133a"
server_key_iv: "dcd49badd393a6ee34a8af26577d4dd4"
server_key_version: "encryptionkey@0"
I20260619 04:39:07.480680 10882 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:39:07.484205 10897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:07.485510 10882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:07.485632 10882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "871cec9c657247f296dae19bbf48df50"
format_stamp: "Formatted at 2026-06-19 04:39:07 on dist-test-slave-9dgf"
server_key: "6161da8a716494af9a8d3ba77f26133a"
server_key_iv: "dcd49badd393a6ee34a8af26577d4dd4"
server_key_version: "encryptionkey@0"
I20260619 04:39:07.485790 10882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:07.499341 10882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:07.503417 10882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:07.503707 10882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:07.504698 10882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:07.506026 10882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:07.506098 10882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:07.506294 10882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:07.506358 10882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260619 04:39:07.539247 10882 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:36603
I20260619 04:39:07.539295 11009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:36603 every 8 connection(s)
I20260619 04:39:07.540530 10882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:07.541517 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 10882
I20260619 04:39:07.541715 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:07.542284 10113 external_mini_cluster.cc:1428] Setting key 4b4bf0a05b4ebe85b0a7118d550c3910
Jun 19 04:39:07 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843947, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
I20260619 04:39:07.564822 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:07.543482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:47733 (local address 127.9.224.126:38583)
0619 04:39:07.543648 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:07.543652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:07.545123 (+ 1471us) server_negotiation.cc:407] Connection header received
0619 04:39:07.548127 (+ 3004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:07.548133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:07.548201 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:07.548287 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:07.550437 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.551623 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.553233 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.554006 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.554161 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:07.558328 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:07.558338 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:07.558345 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:07.558411 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:07.561783 (+ 3372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:07.562564 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:07.562568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:07.562570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:07.562695 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:07.563086 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:07.563089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:07.563091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:07.563388 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:07.563520 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:07.564318 (+ 798us) server_negotiation.cc:299] Negotiation successful
0619 04:39:07.564585 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:39:07.566445 11012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:07.544057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38583 (local address 127.9.224.66:47733)
0619 04:39:07.544940 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:07.545001 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:07.547833 (+ 2832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:07.548559 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:07.548574 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:07.549402 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:07.550172 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:07.550190 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.551766 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.551770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:07.553089 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:07.553100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:07.554217 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:07.554222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:07.554475 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:07.555177 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:07.555199 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:07.558049 (+ 2850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:07.561915 (+ 3866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:07.561922 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:07.561935 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:07.562436 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:07.562791 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:07.562794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:07.562796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:07.562972 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:07.563495 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:07.563501 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:07.563894 (+ 393us) client_negotiation.cc:769] Sending connection context
0619 04:39:07.564193 (+ 299us) client_negotiation.cc:240] Negotiation successful
0619 04:39:07.564810 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":345,"threads_started":1}
I20260619 04:39:07.568001 11010 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38583
I20260619 04:39:07.568341 11010 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:07.569058 11010 heartbeater.cc:511] Master 127.9.224.126:38583 requested a full tablet report, sending...
I20260619 04:39:07.570547 10687 ts_manager.cc:194] Registered new tserver with Master: 871cec9c657247f296dae19bbf48df50 (127.9.224.66:36603)
I20260619 04:39:07.571347 10687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:47733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:07.586330 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38583
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:07.911904 11015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:07.912256 11015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:07.912436 11015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:07.919782 11015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:07.919941 11015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:07.920114 11015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:07.929863 11015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38583
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:07.931259 11015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:07.932637 11015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:07.945820 11020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:07.945878 11021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:07.946499 11023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:07.946574 11015 server_base.cc:1034] running on GCE node
I20260619 04:39:07.947260 11015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:07.948159 11015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:07.949380 11015 hybrid_clock.cc:648] HybridClock initialized: now 1781843947949335 us; error 34 us; skew 500 ppm
I20260619 04:39:07.949736 11015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:07 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843947, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:07.953159 11015 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:07.954795 11015 webserver.cc:460] Webserver started at http://127.9.224.67:41607/ using document root <none> and password file <none>
I20260619 04:39:07.955523 11015 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:07.955667 11015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:07.955988 11015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:07.958979 11015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "5a4ebe567b2d4b949e4a000824a921fd"
format_stamp: "Formatted at 2026-06-19 04:39:07 on dist-test-slave-9dgf"
server_key: "79e67578644edd43eab698a9526938f5"
server_key_iv: "a1a550b1535118d9f03852d21534db1f"
server_key_version: "encryptionkey@0"
I20260619 04:39:07.959794 11015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "5a4ebe567b2d4b949e4a000824a921fd"
format_stamp: "Formatted at 2026-06-19 04:39:07 on dist-test-slave-9dgf"
server_key: "79e67578644edd43eab698a9526938f5"
server_key_iv: "a1a550b1535118d9f03852d21534db1f"
server_key_version: "encryptionkey@0"
I20260619 04:39:07.965077 11015 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:39:07.968703 11030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:07.969992 11015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:07.970157 11015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "5a4ebe567b2d4b949e4a000824a921fd"
format_stamp: "Formatted at 2026-06-19 04:39:07 on dist-test-slave-9dgf"
server_key: "79e67578644edd43eab698a9526938f5"
server_key_iv: "a1a550b1535118d9f03852d21534db1f"
server_key_version: "encryptionkey@0"
I20260619 04:39:07.970435 11015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:07.987663 11015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:07.992336 11015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:07.992632 11015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:07.993739 11015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:07.995455 11015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:07.995527 11015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:07.995680 11015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:07.995731 11015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:08.029106 11015 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:39529
I20260619 04:39:08.029289 11142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:39529 every 8 connection(s)
I20260619 04:39:08.030419 11015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:08.033800 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11015
I20260619 04:39:08.034051 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:08.034628 10113 external_mini_cluster.cc:1428] Setting key 53cc5f524e64f769c09cb283784312df
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843947, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:08.050699 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.032995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:38929 (local address 127.9.224.126:38583)
0619 04:39:08.033246 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.033252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.034490 (+ 1238us) server_negotiation.cc:407] Connection header received
0619 04:39:08.036696 (+ 2206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.036701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.036800 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.036910 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.038576 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.039324 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.040807 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.041208 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.041304 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.044775 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.044780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.044783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.044814 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.047352 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.048101 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.048107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.048111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.048307 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.048788 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.048794 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.048797 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.049134 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.049283 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.050199 (+ 916us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.050448 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260619 04:39:08.052102 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.033485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38583 (local address 127.9.224.67:38929)
0619 04:39:08.034308 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.034361 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:08.036373 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:08.037104 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:08.037113 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:08.037759 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:08.038398 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.038417 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.039454 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.039457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.040645 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.040655 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.041388 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.041392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.041574 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.042307 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:08.042335 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:08.044566 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:08.047469 (+ 2903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:08.047476 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:08.047488 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:08.047901 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:08.048430 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:08.048438 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:08.048443 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:08.048633 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:08.049256 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:08.049265 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:08.049708 (+ 443us) client_negotiation.cc:769] Sending connection context
0619 04:39:08.050100 (+ 392us) client_negotiation.cc:240] Negotiation successful
0619 04:39:08.050678 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":336,"threads_started":1}
I20260619 04:39:08.053551 11143 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38583
I20260619 04:39:08.053866 11143 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:08.054809 11143 heartbeater.cc:511] Master 127.9.224.126:38583 requested a full tablet report, sending...
I20260619 04:39:08.056430 10687 ts_manager.cc:194] Registered new tserver with Master: 5a4ebe567b2d4b949e4a000824a921fd (127.9.224.67:39529)
I20260619 04:39:08.057209 10687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:38929
I20260619 04:39:08.062543 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:39:08.081424 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.068785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37120 (local address 127.9.224.126:38583)
0619 04:39:08.068946 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.068951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.069411 (+ 460us) server_negotiation.cc:407] Connection header received
0619 04:39:08.069604 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.069610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.069686 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.069787 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.071242 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.071991 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.073229 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.073719 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.073849 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.076227 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.076233 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.076237 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.076277 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.078875 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.079494 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.079501 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.079505 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.079641 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.079998 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.080005 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.080008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.080336 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.080577 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.080890 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.081095 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 04:39:08.083465 10876 heartbeater.cc:503] Master 127.9.224.126:38583 was elected leader, sending a full tablet report...
I20260619 04:39:08.087972 10687 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:08.095484 10687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:08.136618 11155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.108056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:41317 (local address 127.0.0.1:59584)
0619 04:39:08.123427 (+ 15371us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.123518 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:08.123820 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:08.127950 (+ 4130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:08.127959 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:08.128003 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:08.128525 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.128542 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.130726 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.130731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.133548 (+ 2817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.133562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.135449 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.135456 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.135661 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.135750 (+ 89us) client_negotiation.cc:769] Sending connection context
0619 04:39:08.135882 (+ 132us) client_negotiation.cc:240] Negotiation successful
0619 04:39:08.136087 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14946,"mutex_wait_us":50,"thread_start_us":16129,"threads_started":1}
I20260619 04:39:08.136780 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.109031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.9.224.67:39529)
0619 04:39:08.125729 (+ 16698us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.125745 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.128574 (+ 2829us) server_negotiation.cc:407] Connection header received
0619 04:39:08.128852 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.128863 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.129095 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.129293 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:08.129922 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.131438 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.133588 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.135233 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.135359 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.135601 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.136262 (+ 661us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.136427 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16448,"thread_start_us":16222,"threads_started":1}
I20260619 04:39:08.136826 11158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.108541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:39529 (local address 127.0.0.1:57490)
0619 04:39:08.128442 (+ 19901us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.128458 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:08.128620 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:08.129305 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:08.129309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:08.129335 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:08.129744 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.129753 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.131573 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.131582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.133396 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.133409 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.135798 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.135805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.136026 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.136068 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 04:39:08.136206 (+ 138us) client_negotiation.cc:240] Negotiation successful
0619 04:39:08.136343 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19772,"mutex_wait_us":21,"thread_start_us":19620,"threads_started":1}
I20260619 04:39:08.137157 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.108791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.9.224.66:36603)
0619 04:39:08.126370 (+ 17579us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.126380 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.127477 (+ 1097us) server_negotiation.cc:407] Connection header received
0619 04:39:08.127819 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.127831 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.128066 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.128257 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:08.129278 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.131204 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.134016 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.135124 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.135210 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.135424 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.136640 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.136840 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17388,"thread_start_us":17161,"threads_started":1}
I20260619 04:39:08.137702 11156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.108203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36603 (local address 127.0.0.1:59298)
0619 04:39:08.127344 (+ 19141us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.127364 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:08.127597 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:08.128591 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:08.128597 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:08.128629 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:08.129075 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.129088 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.131370 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.131378 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.133832 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.133841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.136183 (+ 2342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.136189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.136357 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.136393 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 04:39:08.137113 (+ 720us) client_negotiation.cc:240] Negotiation successful
0619 04:39:08.137269 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19013,"mutex_wait_us":116,"thread_start_us":18412,"threads_started":1}
I20260619 04:39:08.138032 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.108305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59584 (local address 127.9.224.65:41317)
0619 04:39:08.127201 (+ 18896us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.127212 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.127247 (+ 35us) server_negotiation.cc:407] Connection header received
0619 04:39:08.127363 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.127374 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.127698 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.128715 (+ 1017us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:08.128930 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.130580 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.133688 (+ 3108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.135200 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.135364 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.135601 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.137561 (+ 1960us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.137687 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18721,"thread_start_us":18532,"threads_started":1}
I20260619 04:39:08.141391 10811 tablet_service.cc:1467] Processing CreateTablet for tablet 208248b066204a2c9cc7a9943bead330 (DEFAULT_TABLE table=test-table [id=8afd39f076374ded8a14b15fc0e36ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:08.141474 10945 tablet_service.cc:1467] Processing CreateTablet for tablet 208248b066204a2c9cc7a9943bead330 (DEFAULT_TABLE table=test-table [id=8afd39f076374ded8a14b15fc0e36ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:08.141464 11078 tablet_service.cc:1467] Processing CreateTablet for tablet 208248b066204a2c9cc7a9943bead330 (DEFAULT_TABLE table=test-table [id=8afd39f076374ded8a14b15fc0e36ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:08.142762 10811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 208248b066204a2c9cc7a9943bead330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:08.142897 11078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 208248b066204a2c9cc7a9943bead330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:08.142899 10945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 208248b066204a2c9cc7a9943bead330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:08.154371 11161 tablet_bootstrap.cc:492] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: Bootstrap starting.
I20260619 04:39:08.158300 11161 tablet_bootstrap.cc:654] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:08.158666 11163 tablet_bootstrap.cc:492] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: Bootstrap starting.
I20260619 04:39:08.159085 11162 tablet_bootstrap.cc:492] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: Bootstrap starting.
I20260619 04:39:08.159773 11161 log.cc:824] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:08.162164 11163 tablet_bootstrap.cc:654] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:08.162458 11162 tablet_bootstrap.cc:654] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:08.163148 11161 tablet_bootstrap.cc:492] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: No bootstrap required, opened a new log
I20260619 04:39:08.163421 11161 ts_tablet_manager.cc:1397] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 04:39:08.163439 11163 log.cc:824] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:08.163561 11162 log.cc:824] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:08.166800 11163 tablet_bootstrap.cc:492] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: No bootstrap required, opened a new log
I20260619 04:39:08.167071 11163 ts_tablet_manager.cc:1397] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260619 04:39:08.167896 11162 tablet_bootstrap.cc:492] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: No bootstrap required, opened a new log
I20260619 04:39:08.168166 11162 ts_tablet_manager.cc:1397] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260619 04:39:08.174858 11161 raft_consensus.cc:348] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.175374 11161 raft_consensus.cc:374] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:08.175504 11161 raft_consensus.cc:729] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64f1cda99b494d63bb1e429e917065cb, State: Initialized, Role: FOLLOWER
I20260619 04:39:08.176172 11161 consensus_queue.cc:260] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.176271 11162 raft_consensus.cc:348] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.176792 11162 raft_consensus.cc:374] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:08.176970 11162 raft_consensus.cc:729] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 871cec9c657247f296dae19bbf48df50, State: Initialized, Role: FOLLOWER
I20260619 04:39:08.177591 11163 raft_consensus.cc:348] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.177762 11162 consensus_queue.cc:260] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.178146 11161 ts_tablet_manager.cc:1428] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260619 04:39:08.178184 11163 raft_consensus.cc:374] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:08.178454 11163 raft_consensus.cc:729] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4ebe567b2d4b949e4a000824a921fd, State: Initialized, Role: FOLLOWER
I20260619 04:39:08.179230 11010 heartbeater.cc:503] Master 127.9.224.126:38583 was elected leader, sending a full tablet report...
I20260619 04:39:08.179749 11163 consensus_queue.cc:260] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.179935 11162 ts_tablet_manager.cc:1428] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260619 04:39:08.181720 11163 ts_tablet_manager.cc:1428] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
I20260619 04:39:08.182126 11143 heartbeater.cc:503] Master 127.9.224.126:38583 was elected leader, sending a full tablet report...
I20260619 04:39:08.273089 11169 raft_consensus.cc:482] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:08.273371 11169 raft_consensus.cc:504] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.275206 11169 leader_election.cc:288] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64f1cda99b494d63bb1e429e917065cb (127.9.224.65:41317), 871cec9c657247f296dae19bbf48df50 (127.9.224.66:36603)
I20260619 04:39:08.281877 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.275454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:41317 (local address 127.9.224.67:34989)
0619 04:39:08.275828 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.275853 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:08.276004 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:08.276431 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:08.276434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:08.276457 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:08.276692 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.276704 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.277950 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.277956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.279590 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.279602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.281015 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.281022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.281219 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.281255 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 04:39:08.281356 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 04:39:08.281498 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":65}
I20260619 04:39:08.281877 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.275669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:34989 (local address 127.9.224.65:41317)
0619 04:39:08.275885 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.275893 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.275915 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:39:08.276211 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.276217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.276301 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.276402 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:08.276838 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.277824 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.279749 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.280864 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.280995 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.281048 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.281424 (+ 376us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.281612 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260619 04:39:08.282120 11144 tablet.cc:2369] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:08.282490 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.275861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:40827 (local address 127.9.224.66:36603)
0619 04:39:08.276086 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.276095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.276511 (+ 416us) server_negotiation.cc:407] Connection header received
0619 04:39:08.276737 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.276745 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.276837 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.276904 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:08.277483 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.278409 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.280376 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.281379 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.281510 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.281574 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.282043 (+ 469us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.282186 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:39:08.283179 11170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.275609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36603 (local address 127.9.224.67:40827)
0619 04:39:08.276404 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.276421 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:08.276577 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:08.276953 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:08.276957 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:08.276983 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:08.277337 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.277350 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.278580 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.278584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.280224 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:08.280237 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.281654 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.281660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:08.281834 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.281872 (+ 38us) client_negotiation.cc:769] Sending connection context
0619 04:39:08.282673 (+ 801us) client_negotiation.cc:240] Negotiation successful
0619 04:39:08.282814 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":45,"thread_start_us":457,"threads_started":1}
I20260619 04:39:08.283537 10831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "208248b066204a2c9cc7a9943bead330" candidate_uuid: "5a4ebe567b2d4b949e4a000824a921fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64f1cda99b494d63bb1e429e917065cb" is_pre_election: true
I20260619 04:39:08.284135 10831 raft_consensus.cc:2454] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a4ebe567b2d4b949e4a000824a921fd in term 0.
I20260619 04:39:08.284607 10965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "208248b066204a2c9cc7a9943bead330" candidate_uuid: "5a4ebe567b2d4b949e4a000824a921fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "871cec9c657247f296dae19bbf48df50" is_pre_election: true
I20260619 04:39:08.284862 11033 leader_election.cc:302] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a4ebe567b2d4b949e4a000824a921fd, 64f1cda99b494d63bb1e429e917065cb; no voters:
I20260619 04:39:08.285169 10965 raft_consensus.cc:2454] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a4ebe567b2d4b949e4a000824a921fd in term 0.
I20260619 04:39:08.285277 11169 raft_consensus.cc:2781] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:08.285432 11169 raft_consensus.cc:482] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:08.285552 11169 raft_consensus.cc:3037] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:08.287894 11169 raft_consensus.cc:504] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.288560 11169 leader_election.cc:288] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [CANDIDATE]: Term 1 election: Requested vote from peers 64f1cda99b494d63bb1e429e917065cb (127.9.224.65:41317), 871cec9c657247f296dae19bbf48df50 (127.9.224.66:36603)
I20260619 04:39:08.289034 10965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "208248b066204a2c9cc7a9943bead330" candidate_uuid: "5a4ebe567b2d4b949e4a000824a921fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "871cec9c657247f296dae19bbf48df50"
I20260619 04:39:08.289034 10831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "208248b066204a2c9cc7a9943bead330" candidate_uuid: "5a4ebe567b2d4b949e4a000824a921fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64f1cda99b494d63bb1e429e917065cb"
I20260619 04:39:08.289237 10965 raft_consensus.cc:3037] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:08.289273 10831 raft_consensus.cc:3037] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:08.292512 10965 raft_consensus.cc:2454] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a4ebe567b2d4b949e4a000824a921fd in term 1.
I20260619 04:39:08.292506 10831 raft_consensus.cc:2454] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a4ebe567b2d4b949e4a000824a921fd in term 1.
W20260619 04:39:08.292693 11011 tablet.cc:2369] T 208248b066204a2c9cc7a9943bead330 P 871cec9c657247f296dae19bbf48df50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:08.292896 11033 leader_election.cc:302] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a4ebe567b2d4b949e4a000824a921fd, 64f1cda99b494d63bb1e429e917065cb; no voters:
I20260619 04:39:08.293169 11169 raft_consensus.cc:2781] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:08.293706 11169 raft_consensus.cc:686] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [term 1 LEADER]: Becoming Leader. State: Replica: 5a4ebe567b2d4b949e4a000824a921fd, State: Running, Role: LEADER
I20260619 04:39:08.294282 11169 consensus_queue.cc:237] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } }
I20260619 04:39:08.298775 10687 catalog_manager.cc:5495] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a4ebe567b2d4b949e4a000824a921fd (127.9.224.67). New cstate: current_term: 1 leader_uuid: "5a4ebe567b2d4b949e4a000824a921fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64f1cda99b494d63bb1e429e917065cb" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "871cec9c657247f296dae19bbf48df50" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a4ebe567b2d4b949e4a000824a921fd" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39529 } health_report { overall_health: HEALTHY } } }
W20260619 04:39:08.303087 10877 tablet.cc:2369] T 208248b066204a2c9cc7a9943bead330 P 64f1cda99b494d63bb1e429e917065cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:08.342723 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.327592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59600 (local address 127.9.224.65:41317)
0619 04:39:08.327780 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.327785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.328393 (+ 608us) server_negotiation.cc:407] Connection header received
0619 04:39:08.328609 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.328613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.328690 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.328812 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.330297 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.331066 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.332310 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.332710 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.332852 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.336891 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.336908 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.336925 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.336959 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.339885 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.340759 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.340767 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.340769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.340904 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.341284 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.341287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.341290 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.341647 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.341869 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.342117 (+ 248us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.342359 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843948, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843948, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:08.389559 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.375038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59610 (local address 127.9.224.65:41317)
0619 04:39:08.375272 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.375281 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.375656 (+ 375us) server_negotiation.cc:407] Connection header received
0619 04:39:08.375873 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.375877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.375941 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.376047 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.377412 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.378169 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.379474 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.379886 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.380025 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.384237 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.384242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.384246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.384284 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.386981 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.387602 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.387606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.387609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.387743 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.388128 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.388132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.388134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.388424 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.388654 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.388923 (+ 269us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.389167 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:08.435205 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.421081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.9.224.65:41317)
0619 04:39:08.421303 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.421311 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.421619 (+ 308us) server_negotiation.cc:407] Connection header received
0619 04:39:08.421840 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.421844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.421908 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.422011 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.423414 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.424121 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.425339 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.425771 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.425904 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.429812 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.429817 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.429820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.429852 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.432559 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.433242 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.433250 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.433258 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.433376 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.433741 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.433746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.433750 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.434056 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.434333 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.434630 (+ 297us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.434860 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260619 04:39:08.437152 10791 tablet_service.cc:2908] Rejecting scan request for tablet 208248b066204a2c9cc7a9943bead330: Uninitialized: clean time has not yet been initialized
I20260619 04:39:08.440497 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10748
I20260619 04:39:08.452929 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.441312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59624 (local address 127.9.224.65:41317)
0619 04:39:08.441477 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.441481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.441905 (+ 424us) server_negotiation.cc:407] Connection header received
0619 04:39:08.442049 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.442052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.442123 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.442203 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.443421 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.444140 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.445325 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.445737 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.445842 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.447976 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.447981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.447985 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.448013 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.450543 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.451328 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.451332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.451334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.451442 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.451794 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.451797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.451799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.452067 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.452264 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.452534 (+ 270us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.452686 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260619 04:39:08.453768 10871 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:08.541792 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10748
I20260619 04:39:08.558780 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10882
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:08.573215 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.559552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.9.224.66:36603)
0619 04:39:08.559709 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.559713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.559730 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:39:08.559882 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.559885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.559946 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.560071 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.561151 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.561893 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.563151 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.563532 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.563623 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.567640 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.567655 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.567670 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.567707 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.570579 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.571199 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.571207 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.571209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.571333 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.571849 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.571853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.571855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.572282 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.572536 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.572745 (+ 209us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.572910 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 04:39:08.573904 11005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:08.664354 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10882
I20260619 04:39:08.681223 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11015
Jun 19 04:39:08 dist-test-slave-9dgf krb5kdc[10642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:08.692204 11170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.691694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36603 (local address 127.9.224.67:45917)
0619 04:39:08.691880 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.692027 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.66:36603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 04:39:08.692490 11032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.66:36603: connect: Connection refused (error 111)
I20260619 04:39:08.694187 11170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.693750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36603 (local address 127.9.224.67:45191)
0619 04:39:08.693949 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:08.694034 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.66:36603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 04:39:08.694422 11032 consensus_peers.cc:487] T 208248b066204a2c9cc7a9943bead330 P 5a4ebe567b2d4b949e4a000824a921fd -> Peer 871cec9c657247f296dae19bbf48df50 (127.9.224.66:36603): Couldn't send request to peer 871cec9c657247f296dae19bbf48df50. Status: Network error: Client connection negotiation failed: client connection to 127.9.224.66:36603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 04:39:08.698745 11186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:08.682208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.9.224.67:39529)
0619 04:39:08.682813 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:08.682818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:08.682841 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:39:08.682898 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:08.682902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:08.682965 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:08.683097 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:08.684517 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.685215 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.686809 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:08.687238 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:08.687388 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:08.692614 (+ 5226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:08.692625 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:08.692640 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:08.692696 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:08.695954 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.696638 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.696646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.696648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.696787 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:08.697269 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:08.697273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:08.697275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:08.697595 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:08.697809 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:08.698102 (+ 293us) server_negotiation.cc:299] Negotiation successful
0619 04:39:08.698359 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":365,"threads_started":1}
I20260619 04:39:08.699354 11138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:08.795889 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11015
I20260619 04:39:08.812696 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 10655
I20260619 04:39:08.813849 10717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:08.928704 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 10655
2026-06-19T04:39:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4154 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:09 dist-test-slave-9dgf krb5kdc[11192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:09 dist-test-slave-9dgf krb5kdc[11192](info): set up 2 sockets
Jun 19 04:39:09 dist-test-slave-9dgf krb5kdc[11192](info): commencing operation
krb5kdc: starting...
W20260619 04:39:10.022189 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:10 dist-test-slave-9dgf krb5kdc[11192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:10.205600 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37327
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:37327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:10.542006 11205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:10.542349 11205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:10.542454 11205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:10.549712 11205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:10.549830 11205 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 04:39:10.549871 11205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:10.549925 11205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:10.549975 11205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:10.550040 11205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:10.560060 11205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:37327
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:10.561336 11205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:10.562770 11205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:10.574848 11210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:10.574924 11213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:10.574927 11211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:10.575989 11205 server_base.cc:1034] running on GCE node
I20260619 04:39:10.576772 11205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:10.578202 11205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:10.579511 11205 hybrid_clock.cc:648] HybridClock initialized: now 1781843950579443 us; error 39 us; skew 500 ppm
I20260619 04:39:10.579849 11205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:10 dist-test-slave-9dgf krb5kdc[11192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843950, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:10.583025 11205 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:10.584503 11205 webserver.cc:460] Webserver started at http://127.9.224.126:34585/ using document root <none> and password file <none>
I20260619 04:39:10.585161 11205 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:10.585245 11205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:10.585507 11205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:10.588704 11205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "236a365e1ef544358d06a60a075c9633"
format_stamp: "Formatted at 2026-06-19 04:39:10 on dist-test-slave-9dgf"
server_key: "14e1823b11eeb065fe50e00478f6abc4"
server_key_iv: "100665e3e09481e946b5c6d006dbb4c6"
server_key_version: "encryptionkey@0"
I20260619 04:39:10.589514 11205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "236a365e1ef544358d06a60a075c9633"
format_stamp: "Formatted at 2026-06-19 04:39:10 on dist-test-slave-9dgf"
server_key: "14e1823b11eeb065fe50e00478f6abc4"
server_key_iv: "100665e3e09481e946b5c6d006dbb4c6"
server_key_version: "encryptionkey@0"
I20260619 04:39:10.595207 11205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 04:39:10.598861 11220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:10.600370 11205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:10.600528 11205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "236a365e1ef544358d06a60a075c9633"
format_stamp: "Formatted at 2026-06-19 04:39:10 on dist-test-slave-9dgf"
server_key: "14e1823b11eeb065fe50e00478f6abc4"
server_key_iv: "100665e3e09481e946b5c6d006dbb4c6"
server_key_version: "encryptionkey@0"
I20260619 04:39:10.600716 11205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:10.620308 11205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:10.624593 11205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:10.624878 11205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:10.647315 11205 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:37327
I20260619 04:39:10.647343 11281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:37327 every 8 connection(s)
I20260619 04:39:10.648831 11205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:10.653326 11282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:10.653432 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11205
I20260619 04:39:10.653643 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:10.654510 10113 external_mini_cluster.cc:1428] Setting key 3ecba8113bc49a4fd47aca2e52dc81ee
I20260619 04:39:10.668100 11282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: Bootstrap starting.
Jun 19 04:39:10 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843950, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:10.672699 11282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:10.673981 11282 log.cc:824] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:10.677042 11282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: No bootstrap required, opened a new log
I20260619 04:39:10.679951 11285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:10.656717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.9.224.126:37327)
0619 04:39:10.657632 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:10.657644 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:10.657687 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:39:10.660025 (+ 2338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:10.660057 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:10.660615 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:10.661036 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:10.662867 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:10.664241 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:10.666061 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:10.666843 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:10.666983 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:10.672182 (+ 5199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:10.672197 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:10.672221 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:10.672273 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:10.675776 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:10.676526 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:10.676535 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:10.676550 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:10.676712 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:10.677089 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:10.677095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:10.677099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:10.677688 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:10.677989 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:10.678451 (+ 462us) server_negotiation.cc:299] Negotiation successful
0619 04:39:10.678917 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":447,"threads_started":1}
I20260619 04:39:10.685074 11282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236a365e1ef544358d06a60a075c9633" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37327 } }
I20260619 04:39:10.685585 11282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:10.685701 11282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 236a365e1ef544358d06a60a075c9633, State: Initialized, Role: FOLLOWER
I20260619 04:39:10.686410 11282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236a365e1ef544358d06a60a075c9633" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37327 } }
I20260619 04:39:10.686661 11282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:10.686821 11282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:10.687016 11282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:10.689455 11282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236a365e1ef544358d06a60a075c9633" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37327 } }
I20260619 04:39:10.690039 11282 leader_election.cc:302] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 236a365e1ef544358d06a60a075c9633; no voters:
I20260619 04:39:10.690651 11282 leader_election.cc:288] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:10.690811 11287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:10.691614 11287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [term 1 LEADER]: Becoming Leader. State: Replica: 236a365e1ef544358d06a60a075c9633, State: Running, Role: LEADER
I20260619 04:39:10.692179 11287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236a365e1ef544358d06a60a075c9633" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37327 } }
I20260619 04:39:10.692863 11282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:10.695638 11288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "236a365e1ef544358d06a60a075c9633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236a365e1ef544358d06a60a075c9633" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37327 } } }
I20260619 04:39:10.696805 11288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:10.696439 11289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 236a365e1ef544358d06a60a075c9633. Latest consensus state: current_term: 1 leader_uuid: "236a365e1ef544358d06a60a075c9633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236a365e1ef544358d06a60a075c9633" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37327 } } }
I20260619 04:39:10.697389 11289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:10.698644 11292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:10.704192 11292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:10.714352 11292 catalog_manager.cc:1347] Generated new cluster ID: 289150c12e8a4177b2882ff99d6bcaa0
I20260619 04:39:10.714511 11292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:10.735005 11292 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:10.737049 11292 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:10.746816 11292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: Generated new TSK 0
I20260619 04:39:10.747951 11292 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:10.805728 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37327
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:11.154002 11308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:11.154398 11308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:11.154506 11308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:11.162546 11308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:11.162665 11308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:11.162757 11308 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:39:11.162839 11308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:11.172734 11308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:37327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:11.174211 11308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:11.175655 11308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:11.189015 11313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:11.188974 11314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:11.189061 11316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:11.190443 11308 server_base.cc:1034] running on GCE node
I20260619 04:39:11.191149 11308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:11.192059 11308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:11.193288 11308 hybrid_clock.cc:648] HybridClock initialized: now 1781843951193226 us; error 47 us; skew 500 ppm
I20260619 04:39:11.193599 11308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:11 dist-test-slave-9dgf krb5kdc[11192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:11.196838 11308 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:11.198441 11308 webserver.cc:460] Webserver started at http://127.9.224.65:38951/ using document root <none> and password file <none>
I20260619 04:39:11.199095 11308 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:11.199177 11308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:11.199494 11308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:11.202490 11308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "d3cab13d18cd4f498a9af6678eb8159e"
format_stamp: "Formatted at 2026-06-19 04:39:11 on dist-test-slave-9dgf"
server_key: "9e75c1730443b9807cc72a23165ba613"
server_key_iv: "aff925af47a8630555786e8576485351"
server_key_version: "encryptionkey@0"
I20260619 04:39:11.203215 11308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "d3cab13d18cd4f498a9af6678eb8159e"
format_stamp: "Formatted at 2026-06-19 04:39:11 on dist-test-slave-9dgf"
server_key: "9e75c1730443b9807cc72a23165ba613"
server_key_iv: "aff925af47a8630555786e8576485351"
server_key_version: "encryptionkey@0"
I20260619 04:39:11.208266 11308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:39:11.211582 11323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:11.212945 11308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:11.213132 11308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "d3cab13d18cd4f498a9af6678eb8159e"
format_stamp: "Formatted at 2026-06-19 04:39:11 on dist-test-slave-9dgf"
server_key: "9e75c1730443b9807cc72a23165ba613"
server_key_iv: "aff925af47a8630555786e8576485351"
server_key_version: "encryptionkey@0"
I20260619 04:39:11.213358 11308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:11.234130 11308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:11.238746 11308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:11.239054 11308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:11.241863 11308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:11.241976 11308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:11.242179 11308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:11.242311 11308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:39:11 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:11.267030 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.242221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:36119 (local address 127.9.224.126:37327)
0619 04:39:11.242749 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:11.242757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:11.244037 (+ 1280us) server_negotiation.cc:407] Connection header received
0619 04:39:11.246631 (+ 2594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:11.246637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:11.246733 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:11.246852 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:11.248815 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.249906 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.253319 (+ 3413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.253739 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.253880 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.259666 (+ 5786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:11.259678 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:11.259686 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:11.259757 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:11.263413 (+ 3656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.264305 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.264311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.264315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.264447 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.264922 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.264927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.264930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.265204 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:11.265358 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:11.266184 (+ 826us) server_negotiation.cc:299] Negotiation successful
0619 04:39:11.266504 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":268,"threads_started":1}
I20260619 04:39:11.267827 11333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.243085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.9.224.65:36119)
0619 04:39:11.243857 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:11.243920 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:11.246363 (+ 2443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:11.247104 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:11.247112 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:11.247641 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:11.248606 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.248643 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.250082 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.250089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.253173 (+ 3084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.253191 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.253996 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.254004 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.254210 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.255075 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:11.255119 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:11.259299 (+ 4180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:11.263620 (+ 4321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.263633 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.263662 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.264168 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.264565 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.264570 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.264574 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.264793 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.265331 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:11.265339 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:11.265716 (+ 377us) client_negotiation.cc:769] Sending connection context
0619 04:39:11.265991 (+ 275us) client_negotiation.cc:240] Negotiation successful
0619 04:39:11.266591 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":323,"threads_started":1}
I20260619 04:39:11.291638 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.275151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.9.224.65:43619)
0619 04:39:11.275878 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:11.275904 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:11.276086 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:11.276456 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:11.276464 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:11.277246 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:11.277724 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.277740 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.278847 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.278854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.281203 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.281226 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.282130 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.282140 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.282414 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.283278 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:11.283314 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:11.284454 (+ 1140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:11.288919 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.288924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.288927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.289319 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.289804 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.289807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.289810 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.289956 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.290731 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:11.290734 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:11.290904 (+ 170us) client_negotiation.cc:769] Sending connection context
0619 04:39:11.291045 (+ 141us) client_negotiation.cc:240] Negotiation successful
0619 04:39:11.291299 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":331,"threads_started":1}
I20260619 04:39:11.292008 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.274975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:43619 (local address 127.9.224.126:37327)
0619 04:39:11.275168 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:11.275174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:11.276017 (+ 843us) server_negotiation.cc:407] Connection header received
0619 04:39:11.276238 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:11.276243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:11.276308 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:11.276392 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:11.277873 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.278668 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.281404 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.281899 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.282049 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.284669 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:11.284673 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:11.284677 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:11.284710 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:11.288732 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.289444 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.289452 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.289458 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.289654 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.290075 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.290082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.290088 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.290602 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:11.290789 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:11.291204 (+ 415us) server_negotiation.cc:299] Negotiation successful
0619 04:39:11.291521 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 04:39:11.299002 11308 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:42163
I20260619 04:39:11.299044 11443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:42163 every 8 connection(s)
I20260619 04:39:11.300307 11308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:11.302345 11444 heartbeater.cc:347] Connected to a master server at 127.9.224.126:37327
I20260619 04:39:11.302580 11444 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:11.303203 11444 heartbeater.cc:511] Master 127.9.224.126:37327 requested a full tablet report, sending...
I20260619 04:39:11.305164 11237 ts_manager.cc:194] Registered new tserver with Master: d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65:42163)
I20260619 04:39:11.306777 11237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:36119
I20260619 04:39:11.307080 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11308
I20260619 04:39:11.307300 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:11.308125 10113 external_mini_cluster.cc:1428] Setting key b45feb592e6993aa56ed00093c718c39
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:11.346658 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37327
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:11.672341 11448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:11.672691 11448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:11.672856 11448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:11.681530 11448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:11.681690 11448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:11.681844 11448 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:39:11.681983 11448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:11.692080 11448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:37327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:11.693542 11448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:11.694977 11448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:11.708663 11456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:11.708815 11453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:11.708818 11454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:11.711910 11448 server_base.cc:1034] running on GCE node
I20260619 04:39:11.712610 11448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:11.713762 11448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:11.715042 11448 hybrid_clock.cc:648] HybridClock initialized: now 1781843951714961 us; error 66 us; skew 500 ppm
I20260619 04:39:11.715392 11448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:11 dist-test-slave-9dgf krb5kdc[11192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:11.722584 11448 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:11.724370 11448 webserver.cc:460] Webserver started at http://127.9.224.66:43453/ using document root <none> and password file <none>
I20260619 04:39:11.725153 11448 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:11.725286 11448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:11.725630 11448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:11.728854 11448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "7549928b3f5c40b88cc65f506de4a698"
format_stamp: "Formatted at 2026-06-19 04:39:11 on dist-test-slave-9dgf"
server_key: "99923477fee28365010e1a5871da78fb"
server_key_iv: "05d8801984952ee4b8090abf03cb4348"
server_key_version: "encryptionkey@0"
I20260619 04:39:11.729707 11448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "7549928b3f5c40b88cc65f506de4a698"
format_stamp: "Formatted at 2026-06-19 04:39:11 on dist-test-slave-9dgf"
server_key: "99923477fee28365010e1a5871da78fb"
server_key_iv: "05d8801984952ee4b8090abf03cb4348"
server_key_version: "encryptionkey@0"
I20260619 04:39:11.735375 11448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 04:39:11.739472 11463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:11.740909 11448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:11.741111 11448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "7549928b3f5c40b88cc65f506de4a698"
format_stamp: "Formatted at 2026-06-19 04:39:11 on dist-test-slave-9dgf"
server_key: "99923477fee28365010e1a5871da78fb"
server_key_iv: "05d8801984952ee4b8090abf03cb4348"
server_key_version: "encryptionkey@0"
I20260619 04:39:11.741369 11448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:11.762408 11448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:11.766676 11448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:11.766966 11448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:11.769804 11448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:11.769914 11448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:11.770077 11448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:11.770153 11448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:39:11 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843951, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:11.793946 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.770221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:41993 (local address 127.9.224.126:37327)
0619 04:39:11.770445 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:11.770452 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:11.772047 (+ 1595us) server_negotiation.cc:407] Connection header received
0619 04:39:11.774206 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:11.774213 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:11.774329 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:11.774465 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:11.776899 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.778001 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.780555 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.781001 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.781138 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.786181 (+ 5043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:11.786186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:11.786190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:11.786286 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:11.789712 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.791040 (+ 1328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.791046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.791050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.791225 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.791802 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.791808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.791811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.792228 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:11.792410 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:11.793317 (+ 907us) server_negotiation.cc:299] Negotiation successful
0619 04:39:11.793554 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260619 04:39:11.795300 11472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.770935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.9.224.66:41993)
0619 04:39:11.771858 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:11.771919 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:11.773807 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:11.774754 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:11.774771 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:11.775647 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:11.776634 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.776665 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.778159 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.778166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.780398 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.780410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.781250 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.781260 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.781631 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.782622 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:11.782661 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:11.785942 (+ 3281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:11.789883 (+ 3941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.789896 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.789924 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.790830 (+ 906us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.791406 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.791413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.791418 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.791657 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.792362 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:11.792374 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:11.792854 (+ 480us) client_negotiation.cc:769] Sending connection context
0619 04:39:11.793207 (+ 353us) client_negotiation.cc:240] Negotiation successful
0619 04:39:11.793770 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":404,"threads_started":1}
I20260619 04:39:11.819989 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.804931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:60757 (local address 127.9.224.126:37327)
0619 04:39:11.805188 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:11.805198 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:11.805716 (+ 518us) server_negotiation.cc:407] Connection header received
0619 04:39:11.805941 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:11.805953 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:11.806018 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:11.806099 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:11.807792 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.808758 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.810821 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.811226 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.811354 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.813392 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:11.813397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:11.813401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:11.813442 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:11.816311 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.817416 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.817424 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.817429 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.817596 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:11.818119 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:11.818128 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:11.818134 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:11.818716 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:11.818892 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:11.819418 (+ 526us) server_negotiation.cc:299] Negotiation successful
0619 04:39:11.819639 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:11.820149 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:11.804832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.9.224.66:60757)
0619 04:39:11.805576 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:11.805602 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:11.805808 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:11.806168 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:11.806176 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:11.807015 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:11.807580 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.807597 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.808907 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.808916 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.810675 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:11.810687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:11.811424 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:11.811432 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:11.811585 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:11.812346 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:11.812368 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:11.813167 (+ 799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:11.816484 (+ 3317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.816493 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.816499 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.817291 (+ 792us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.817747 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:11.817755 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:11.817761 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:11.817979 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:11.818894 (+ 915us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:11.818900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:11.819147 (+ 247us) client_negotiation.cc:769] Sending connection context
0619 04:39:11.819310 (+ 163us) client_negotiation.cc:240] Negotiation successful
0619 04:39:11.819661 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":363,"threads_started":1}
I20260619 04:39:11.833495 11448 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:36831
I20260619 04:39:11.833515 11582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:36831 every 8 connection(s)
I20260619 04:39:11.834870 11448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:11.835621 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11448
I20260619 04:39:11.835879 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:11.836440 10113 external_mini_cluster.cc:1428] Setting key b3b81e5dd4c8a94f2b2430725bf052d1
I20260619 04:39:11.837445 11583 heartbeater.cc:347] Connected to a master server at 127.9.224.126:37327
I20260619 04:39:11.837724 11583 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:11.838518 11583 heartbeater.cc:511] Master 127.9.224.126:37327 requested a full tablet report, sending...
I20260619 04:39:11.839924 11237 ts_manager.cc:194] Registered new tserver with Master: 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831)
I20260619 04:39:11.840758 11237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:41993
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:11.875665 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:37327
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:12.199497 11587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:12.199790 11587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:12.200018 11587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:12.207718 11587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:12.207844 11587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:12.207983 11587 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:39:12.208108 11587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:12.218451 11587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:37327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:12.219900 11587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:12.221323 11587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:12.234977 11592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:12.234977 11595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:12.235018 11593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:12.239761 11587 server_base.cc:1034] running on GCE node
I20260619 04:39:12.240404 11587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:12.241423 11587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:12.242630 11587 hybrid_clock.cc:648] HybridClock initialized: now 1781843952242569 us; error 85 us; skew 500 ppm
I20260619 04:39:12.242945 11587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:12 dist-test-slave-9dgf krb5kdc[11192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:12.246138 11587 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:12.247705 11587 webserver.cc:460] Webserver started at http://127.9.224.67:39813/ using document root <none> and password file <none>
I20260619 04:39:12.248466 11587 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:12.248597 11587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:12.248930 11587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:12.251942 11587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "a1d118f35c674406aae9c37d9530c383"
format_stamp: "Formatted at 2026-06-19 04:39:12 on dist-test-slave-9dgf"
server_key: "3f035d39266048ed0e3ec11283c46da3"
server_key_iv: "8c076eb9b73566572c34a917030f3044"
server_key_version: "encryptionkey@0"
I20260619 04:39:12.252719 11587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "a1d118f35c674406aae9c37d9530c383"
format_stamp: "Formatted at 2026-06-19 04:39:12 on dist-test-slave-9dgf"
server_key: "3f035d39266048ed0e3ec11283c46da3"
server_key_iv: "8c076eb9b73566572c34a917030f3044"
server_key_version: "encryptionkey@0"
I20260619 04:39:12.257856 11587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:39:12.261229 11602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:12.262651 11587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:12.262831 11587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "a1d118f35c674406aae9c37d9530c383"
format_stamp: "Formatted at 2026-06-19 04:39:12 on dist-test-slave-9dgf"
server_key: "3f035d39266048ed0e3ec11283c46da3"
server_key_iv: "8c076eb9b73566572c34a917030f3044"
server_key_version: "encryptionkey@0"
I20260619 04:39:12.263053 11587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:12.298792 11587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:12.304272 11587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:12.304636 11587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:12.307782 11587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:12.307897 11587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:12.308069 11587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:12.308179 11587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260619 04:39:12.310137 11444 heartbeater.cc:503] Master 127.9.224.126:37327 was elected leader, sending a full tablet report...
Jun 19 04:39:12 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:12.332962 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.308299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:40943 (local address 127.9.224.126:37327)
0619 04:39:12.308522 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.308530 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.310075 (+ 1545us) server_negotiation.cc:407] Connection header received
0619 04:39:12.312716 (+ 2641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.312721 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.312823 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.312929 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:12.315295 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.316652 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.319384 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.320052 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.320214 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.325297 (+ 5083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:12.325306 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:12.325312 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:12.325362 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:12.329220 (+ 3858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.330300 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.330306 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.330312 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.330488 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.331072 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.331080 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.331085 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.331448 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:12.331606 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.332343 (+ 737us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.332586 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 04:39:12.334033 11611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.308992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.9.224.67:40943)
0619 04:39:12.309867 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.309947 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.312376 (+ 2429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.313252 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.313270 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.314163 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:12.315069 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.315116 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.316837 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.316843 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.319225 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.319238 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.320350 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.320385 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.320777 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.321614 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:12.321660 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:12.325015 (+ 3355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:12.329395 (+ 4380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:12.329403 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:12.329416 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:12.330140 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:12.330645 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:12.330652 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:12.330658 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:12.330883 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:12.331589 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:12.331606 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:12.331972 (+ 366us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.332239 (+ 267us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.332781 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":396,"threads_started":1}
I20260619 04:39:12.357878 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.341055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:52237 (local address 127.9.224.126:37327)
0619 04:39:12.341285 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.341294 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.341929 (+ 635us) server_negotiation.cc:407] Connection header received
0619 04:39:12.342131 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.342135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.342208 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.342370 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:12.343550 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.344246 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.345957 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.346749 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.346906 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.349956 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:12.349964 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:12.349969 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:12.350017 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:12.354015 (+ 3998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.355211 (+ 1196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.355220 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.355225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.355397 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.355952 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.355960 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.355965 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.356369 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:12.356526 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.357216 (+ 690us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.357488 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:12.358059 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.341055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.9.224.67:52237)
0619 04:39:12.341800 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.341824 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.342005 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.342400 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.342405 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.343118 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:12.343405 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.343414 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.344375 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.344382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.345792 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.345814 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.346982 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.346992 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.347278 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.348166 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:12.348194 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:12.349688 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:12.354210 (+ 4522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:12.354218 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:12.354255 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:12.355031 (+ 776us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:12.355576 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:12.355582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:12.355588 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:12.355785 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:12.356531 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:12.356539 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:12.356833 (+ 294us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.357087 (+ 254us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.357554 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":384,"threads_started":1}
I20260619 04:39:12.359742 11587 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:46361
I20260619 04:39:12.359827 11721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:46361 every 8 connection(s)
I20260619 04:39:12.361159 11587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:12.363420 11722 heartbeater.cc:347] Connected to a master server at 127.9.224.126:37327
I20260619 04:39:12.363654 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11587
I20260619 04:39:12.363729 11722 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:12.363873 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:12.364300 10113 external_mini_cluster.cc:1428] Setting key 152977130c4a62c72414eb38a9ee4789
I20260619 04:39:12.364442 11722 heartbeater.cc:511] Master 127.9.224.126:37327 requested a full tablet report, sending...
I20260619 04:39:12.365724 11237 ts_manager.cc:194] Registered new tserver with Master: a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361)
I20260619 04:39:12.366735 11237 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:40943
I20260619 04:39:12.367430 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 04:39:12 dist-test-slave-9dgf krb5kdc[11192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 04:39:12 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:12.415458 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.400950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.9.224.126:37327)
0619 04:39:12.401137 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.401142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.401548 (+ 406us) server_negotiation.cc:407] Connection header received
0619 04:39:12.401727 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.401731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.401796 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.401894 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:12.403521 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.404339 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.405695 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.406129 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.406320 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.410112 (+ 3792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:12.410117 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:12.410120 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:12.410158 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:12.412896 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.413501 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.413505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.413507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.413629 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.414038 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.414041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.414043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.414399 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:12.414582 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.414977 (+ 395us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.415177 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 04:39:12.420038 11237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:12.426882 11237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:12.450557 11736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.439950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42760 (local address 127.9.224.67:46361)
0619 04:39:12.440884 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.440895 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.441710 (+ 815us) server_negotiation.cc:407] Connection header received
0619 04:39:12.442030 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.442040 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.442368 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.442530 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.443723 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.445087 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.448139 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.449090 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.449255 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.449497 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.449801 (+ 304us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.450165 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":511,"threads_started":1}
I20260619 04:39:12.450829 11739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.441520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60770 (local address 127.9.224.66:36831)
0619 04:39:12.442112 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.442120 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.442400 (+ 280us) server_negotiation.cc:407] Connection header received
0619 04:39:12.442588 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.442603 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.442765 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.442956 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.443827 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.445384 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.448166 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.449568 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.449720 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.449875 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.450355 (+ 480us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.450512 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":320,"threads_started":1}
I20260619 04:39:12.451435 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.440719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59300 (local address 127.9.224.65:42163)
0619 04:39:12.441611 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.441618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.442330 (+ 712us) server_negotiation.cc:407] Connection header received
0619 04:39:12.442564 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.442572 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.442818 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.442996 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.443952 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.445384 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.448198 (+ 2814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.449580 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.449689 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.449879 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.451029 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.451227 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":635,"threads_started":1}
I20260619 04:39:12.452047 11737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.440219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:42163 (local address 127.0.0.1:59300)
0619 04:39:12.442196 (+ 1977us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.442216 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.442359 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.443175 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.443180 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.443201 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.443754 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.443765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.445547 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.445552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.448023 (+ 2471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.448037 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.450080 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.450086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.450288 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.450329 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.450411 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.450543 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1834,"mutex_wait_us":50,"thread_start_us":871,"threads_started":1}
I20260619 04:39:12.452054 11735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.439737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:46361 (local address 127.0.0.1:42760)
0619 04:39:12.441522 (+ 1785us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.441560 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.441756 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.442882 (+ 1126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.442889 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.442923 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.443454 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.443471 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.445226 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.445233 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.447956 (+ 2723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.447972 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.449303 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.449309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.449495 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.449553 (+ 58us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.450859 (+ 1306us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.450997 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1537,"mutex_wait_us":25,"thread_start_us":429,"threads_started":1}
I20260619 04:39:12.452133 11740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.441193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36831 (local address 127.0.0.1:60770)
0619 04:39:12.442218 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.442284 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.442419 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.442945 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.442949 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.442975 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.443620 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.443633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.445550 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.445557 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.448020 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.448032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.449800 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.449805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.449959 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.449993 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.450088 (+ 95us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.450989 (+ 901us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":899,"mutex_wait_us":854,"thread_start_us":1433,"threads_started":1}
I20260619 04:39:12.456123 11652 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad3b4879b384a779f3ccd331202d029 (DEFAULT_TABLE table=test-table [id=4cb2971810fb4b23b39d0338c39c46f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:12.456123 11374 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad3b4879b384a779f3ccd331202d029 (DEFAULT_TABLE table=test-table [id=4cb2971810fb4b23b39d0338c39c46f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:12.457624 11374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad3b4879b384a779f3ccd331202d029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.457639 11652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad3b4879b384a779f3ccd331202d029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.460228 11513 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad3b4879b384a779f3ccd331202d029 (DEFAULT_TABLE table=test-table [id=4cb2971810fb4b23b39d0338c39c46f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:12.461310 11513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad3b4879b384a779f3ccd331202d029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.474251 11741 tablet_bootstrap.cc:492] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Bootstrap starting.
I20260619 04:39:12.476351 11742 tablet_bootstrap.cc:492] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Bootstrap starting.
I20260619 04:39:12.478211 11741 tablet_bootstrap.cc:654] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.478266 11743 tablet_bootstrap.cc:492] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Bootstrap starting.
I20260619 04:39:12.479645 11741 log.cc:824] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:12.480216 11742 tablet_bootstrap.cc:654] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.481343 11743 tablet_bootstrap.cc:654] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.481328 11742 log.cc:824] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:12.482558 11743 log.cc:824] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:12.484000 11741 tablet_bootstrap.cc:492] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: No bootstrap required, opened a new log
I20260619 04:39:12.484310 11741 ts_tablet_manager.cc:1397] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260619 04:39:12.485064 11742 tablet_bootstrap.cc:492] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: No bootstrap required, opened a new log
I20260619 04:39:12.485324 11742 ts_tablet_manager.cc:1397] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260619 04:39:12.495939 11741 raft_consensus.cc:348] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.495934 11742 raft_consensus.cc:348] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.496289 11743 tablet_bootstrap.cc:492] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: No bootstrap required, opened a new log
I20260619 04:39:12.496403 11742 raft_consensus.cc:374] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.496402 11741 raft_consensus.cc:374] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.496508 11741 raft_consensus.cc:729] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7549928b3f5c40b88cc65f506de4a698, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.496583 11742 raft_consensus.cc:729] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cab13d18cd4f498a9af6678eb8159e, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.496640 11743 ts_tablet_manager.cc:1397] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.014s
I20260619 04:39:12.497195 11741 consensus_queue.cc:260] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.497220 11742 consensus_queue.cc:260] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.504086 11742 ts_tablet_manager.cc:1428] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Time spent starting tablet: real 0.019s user 0.013s sys 0.006s
I20260619 04:39:12.504307 11583 heartbeater.cc:503] Master 127.9.224.126:37327 was elected leader, sending a full tablet report...
I20260619 04:39:12.505719 11743 raft_consensus.cc:348] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.506173 11743 raft_consensus.cc:374] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.506290 11743 raft_consensus.cc:729] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d118f35c674406aae9c37d9530c383, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.506477 11741 ts_tablet_manager.cc:1428] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Time spent starting tablet: real 0.022s user 0.016s sys 0.004s
I20260619 04:39:12.507170 11743 consensus_queue.cc:260] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.508911 11722 heartbeater.cc:503] Master 127.9.224.126:37327 was elected leader, sending a full tablet report...
I20260619 04:39:12.509632 11743 ts_tablet_manager.cc:1428] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260619 04:39:12.552901 11445 tablet.cc:2369] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:12.572723 11747 raft_consensus.cc:482] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:12.573069 11747 raft_consensus.cc:504] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.574841 11747 leader_election.cc:288] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361), 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831)
I20260619 04:39:12.581605 11736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.575143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:35765 (local address 127.9.224.67:46361)
0619 04:39:12.575391 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.575401 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.575971 (+ 570us) server_negotiation.cc:407] Connection header received
0619 04:39:12.576299 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.576305 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.576376 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.576425 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.577236 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.577958 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.579928 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.580682 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.580873 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.580951 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.581221 (+ 270us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.581343 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260619 04:39:12.581673 11739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.576065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:52469 (local address 127.9.224.66:36831)
0619 04:39:12.576260 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.576265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.576637 (+ 372us) server_negotiation.cc:407] Connection header received
0619 04:39:12.576726 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.576733 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.576811 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.576909 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.577463 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.578158 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.579948 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.580739 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.580939 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.581013 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.581279 (+ 266us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.581410 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:39:12.581760 11750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.575143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:46361 (local address 127.9.224.65:35765)
0619 04:39:12.575843 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.575884 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.576087 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.576608 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.576614 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.576643 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.577090 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.577101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.578082 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.578090 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.579776 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.579788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.580905 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.580910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.581058 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.581081 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.581196 (+ 115us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.581324 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":76,"thread_start_us":372,"threads_started":1}
I20260619 04:39:12.581817 11751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.575907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36831 (local address 127.9.224.65:52469)
0619 04:39:12.576523 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.576537 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.576638 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.576926 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.576929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.576945 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.577298 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.577306 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.578319 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.578330 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.579780 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.579798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.580968 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.580974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.581124 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.581146 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.581253 (+ 107us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.581374 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":20,"thread_start_us":361,"threads_started":1}
I20260619 04:39:12.582793 11538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad3b4879b384a779f3ccd331202d029" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7549928b3f5c40b88cc65f506de4a698" is_pre_election: true
I20260619 04:39:12.582804 11672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad3b4879b384a779f3ccd331202d029" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d118f35c674406aae9c37d9530c383" is_pre_election: true
I20260619 04:39:12.583279 11538 raft_consensus.cc:2454] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 0.
I20260619 04:39:12.583277 11672 raft_consensus.cc:2454] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 0.
I20260619 04:39:12.583946 11324 leader_election.cc:302] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7549928b3f5c40b88cc65f506de4a698, d3cab13d18cd4f498a9af6678eb8159e; no voters:
I20260619 04:39:12.584358 11747 raft_consensus.cc:2781] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:12.584508 11747 raft_consensus.cc:482] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:12.584699 11747 raft_consensus.cc:3037] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Advancing to term 1
W20260619 04:39:12.587010 11584 tablet.cc:2369] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:12.587316 11747 raft_consensus.cc:504] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.587926 11747 leader_election.cc:288] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 election: Requested vote from peers a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361), 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831)
I20260619 04:39:12.588467 11672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad3b4879b384a779f3ccd331202d029" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d118f35c674406aae9c37d9530c383"
I20260619 04:39:12.588546 11538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad3b4879b384a779f3ccd331202d029" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7549928b3f5c40b88cc65f506de4a698"
I20260619 04:39:12.588673 11672 raft_consensus.cc:3037] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:12.588832 11538 raft_consensus.cc:3037] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:12.591023 11538 raft_consensus.cc:2454] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 1.
I20260619 04:39:12.591040 11672 raft_consensus.cc:2454] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 1.
I20260619 04:39:12.591472 11324 leader_election.cc:302] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1d118f35c674406aae9c37d9530c383, d3cab13d18cd4f498a9af6678eb8159e; no voters:
I20260619 04:39:12.591791 11747 raft_consensus.cc:2781] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:12.592239 11747 raft_consensus.cc:686] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 1 LEADER]: Becoming Leader. State: Replica: d3cab13d18cd4f498a9af6678eb8159e, State: Running, Role: LEADER
I20260619 04:39:12.592725 11747 consensus_queue.cc:237] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } }
I20260619 04:39:12.597575 11237 catalog_manager.cc:5495] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65). New cstate: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } health_report { overall_health: HEALTHY } } }
W20260619 04:39:12.613279 11723 tablet.cc:2369] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:12.653827 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.648399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59312 (local address 127.9.224.65:42163)
0619 04:39:12.648593 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.648600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.648621 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:39:12.648969 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.648973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.649060 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.649211 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:12.649580 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.650342 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.651643 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.652053 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.652194 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.652673 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:12.653202 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:12.653354 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.653485 (+ 131us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.653566 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 04:39:12.662746 11538 raft_consensus.cc:1261] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Refusing update from remote peer d3cab13d18cd4f498a9af6678eb8159e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:12.662801 11672 raft_consensus.cc:1261] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Refusing update from remote peer d3cab13d18cd4f498a9af6678eb8159e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:12.663831 11752 consensus_queue.cc:1035] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:12.664239 11747 consensus_queue.cc:1035] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:12.695534 11236 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:12.695880 11236 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:12.700112 11236 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: Sending DeleteTablet for 3 replicas of tablet 7ad3b4879b384a779f3ccd331202d029
I20260619 04:39:12.701388 11652 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad3b4879b384a779f3ccd331202d029 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:12 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42760
I20260619 04:39:12.701485 11513 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad3b4879b384a779f3ccd331202d029 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:12 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60770
I20260619 04:39:12.701485 11374 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad3b4879b384a779f3ccd331202d029 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:12 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:59300
I20260619 04:39:12.703835 11237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:12.704855 11237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:12.715118 11373 tablet_service.cc:1467] Processing CreateTablet for tablet c7842e97037e4b95b49c4f6977eef8aa (DEFAULT_TABLE table=test-table [id=45e926a1b3c448bebaeeaa8a0d1c6030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:12.715901 11373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7842e97037e4b95b49c4f6977eef8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.720247 11512 tablet_service.cc:1467] Processing CreateTablet for tablet c7842e97037e4b95b49c4f6977eef8aa (DEFAULT_TABLE table=test-table [id=45e926a1b3c448bebaeeaa8a0d1c6030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:12.721110 11512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7842e97037e4b95b49c4f6977eef8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.721653 11765 tablet_replica.cc:330] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: stopping tablet replica
I20260619 04:39:12.722208 11765 raft_consensus.cc:2229] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:12.722860 11765 raft_consensus.cc:2258] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:12.723734 11767 tablet_replica.cc:330] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: stopping tablet replica
I20260619 04:39:12.724211 11767 raft_consensus.cc:2229] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:12.724704 11767 raft_consensus.cc:2258] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:12.725981 11765 ts_tablet_manager.cc:1905] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:12.726182 11651 tablet_service.cc:1467] Processing CreateTablet for tablet c7842e97037e4b95b49c4f6977eef8aa (DEFAULT_TABLE table=test-table [id=45e926a1b3c448bebaeeaa8a0d1c6030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:12.726773 11651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7842e97037e4b95b49c4f6977eef8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.727258 11767 ts_tablet_manager.cc:1905] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:12.735991 11765 ts_tablet_manager.cc:1918] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:12.736266 11765 log.cc:1196] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/7ad3b4879b384a779f3ccd331202d029
I20260619 04:39:12.736502 11766 tablet_replica.cc:330] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: stopping tablet replica
I20260619 04:39:12.736846 11765 ts_tablet_manager.cc:1939] T 7ad3b4879b384a779f3ccd331202d029 P 7549928b3f5c40b88cc65f506de4a698: Deleting consensus metadata
I20260619 04:39:12.737134 11766 raft_consensus.cc:2229] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:12.737923 11766 raft_consensus.cc:2258] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:12.743616 11767 ts_tablet_manager.cc:1918] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:12.743822 11767 log.cc:1196] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/7ad3b4879b384a779f3ccd331202d029
I20260619 04:39:12.744416 11767 ts_tablet_manager.cc:1939] T 7ad3b4879b384a779f3ccd331202d029 P a1d118f35c674406aae9c37d9530c383: Deleting consensus metadata
I20260619 04:39:12.746479 11743 tablet_bootstrap.cc:492] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Bootstrap starting.
I20260619 04:39:12.748239 11766 ts_tablet_manager.cc:1905] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:12.748335 11743 tablet_bootstrap.cc:654] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.748489 11741 tablet_bootstrap.cc:492] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Bootstrap starting.
I20260619 04:39:12.750044 11741 tablet_bootstrap.cc:654] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.753968 11742 tablet_bootstrap.cc:492] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Bootstrap starting.
I20260619 04:39:12.755296 11221 catalog_manager.cc:4841] TS 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831): tablet 7ad3b4879b384a779f3ccd331202d029 (table test-table [id=4cb2971810fb4b23b39d0338c39c46f6]) successfully deleted
I20260619 04:39:12.755848 11221 catalog_manager.cc:4841] TS a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361): tablet 7ad3b4879b384a779f3ccd331202d029 (table test-table [id=4cb2971810fb4b23b39d0338c39c46f6]) successfully deleted
I20260619 04:39:12.756364 11742 tablet_bootstrap.cc:654] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.764014 11742 tablet_bootstrap.cc:492] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: No bootstrap required, opened a new log
I20260619 04:39:12.764346 11742 ts_tablet_manager.cc:1397] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260619 04:39:12.764364 11766 ts_tablet_manager.cc:1918] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:12.765425 11766 log.cc:1196] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/7ad3b4879b384a779f3ccd331202d029
I20260619 04:39:12.765280 11742 raft_consensus.cc:348] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.765782 11742 raft_consensus.cc:374] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.765949 11742 raft_consensus.cc:729] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cab13d18cd4f498a9af6678eb8159e, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.766242 11766 ts_tablet_manager.cc:1939] T 7ad3b4879b384a779f3ccd331202d029 P d3cab13d18cd4f498a9af6678eb8159e: Deleting consensus metadata
I20260619 04:39:12.766801 11742 consensus_queue.cc:260] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.767640 11741 tablet_bootstrap.cc:492] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: No bootstrap required, opened a new log
I20260619 04:39:12.767802 11741 ts_tablet_manager.cc:1397] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.007s
I20260619 04:39:12.768422 11222 catalog_manager.cc:4841] TS d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65:42163): tablet 7ad3b4879b384a779f3ccd331202d029 (table test-table [id=4cb2971810fb4b23b39d0338c39c46f6]) successfully deleted
I20260619 04:39:12.768703 11741 raft_consensus.cc:348] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.768934 11741 raft_consensus.cc:374] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.769033 11741 raft_consensus.cc:729] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7549928b3f5c40b88cc65f506de4a698, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.769349 11741 consensus_queue.cc:260] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.770676 11741 ts_tablet_manager.cc:1428] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:12.771351 11743 tablet_bootstrap.cc:492] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: No bootstrap required, opened a new log
I20260619 04:39:12.771535 11743 ts_tablet_manager.cc:1397] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.006s
I20260619 04:39:12.771732 11742 ts_tablet_manager.cc:1428] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260619 04:39:12.772454 11743 raft_consensus.cc:348] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.772710 11743 raft_consensus.cc:374] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.772802 11743 raft_consensus.cc:729] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d118f35c674406aae9c37d9530c383, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.773128 11743 consensus_queue.cc:260] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.773737 11743 ts_tablet_manager.cc:1428] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 04:39:12.797350 11749 raft_consensus.cc:482] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:12.797674 11749 raft_consensus.cc:504] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.799413 11749 leader_election.cc:288] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65:42163), 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831)
I20260619 04:39:12.807715 11611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.799661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:42163 (local address 127.9.224.67:38269)
0619 04:39:12.800113 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.800136 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.800290 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.801421 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.801427 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.801459 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.801690 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.801702 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.803104 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.803113 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.805099 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.805115 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.806830 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.806837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.807085 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.807126 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.807243 (+ 117us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.807382 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":87}
I20260619 04:39:12.807744 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.800885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:38269 (local address 127.9.224.65:42163)
0619 04:39:12.801084 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.801093 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.801111 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:39:12.801192 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.801198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.801278 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.801379 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.801854 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.802921 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.805295 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.806646 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.806801 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.806871 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.807281 (+ 410us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.807407 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260619 04:39:12.807737 11739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.799970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:47017 (local address 127.9.224.66:36831)
0619 04:39:12.800579 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.800587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.800608 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:39:12.800685 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.800691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.800772 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.800874 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:12.801475 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.802550 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.805400 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.806654 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.806798 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.806871 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.807353 (+ 482us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.807479 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472}
I20260619 04:39:12.808755 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.799814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36831 (local address 127.9.224.67:47017)
0619 04:39:12.800472 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.800486 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.800576 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.800913 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.800919 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.800945 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:12.801282 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.801293 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.802683 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.802689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.805166 (+ 2477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.805183 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.807032 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.807036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.807159 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.807181 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.808388 (+ 1207us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.808482 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":55,"thread_start_us":375,"threads_started":1}
I20260619 04:39:12.808633 11396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7842e97037e4b95b49c4f6977eef8aa" candidate_uuid: "a1d118f35c674406aae9c37d9530c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cab13d18cd4f498a9af6678eb8159e" is_pre_election: true
I20260619 04:39:12.809144 11396 raft_consensus.cc:2454] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1d118f35c674406aae9c37d9530c383 in term 0.
I20260619 04:39:12.809405 11538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7842e97037e4b95b49c4f6977eef8aa" candidate_uuid: "a1d118f35c674406aae9c37d9530c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7549928b3f5c40b88cc65f506de4a698" is_pre_election: true
I20260619 04:39:12.809651 11538 raft_consensus.cc:2454] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1d118f35c674406aae9c37d9530c383 in term 0.
I20260619 04:39:12.809818 11604 leader_election.cc:302] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1d118f35c674406aae9c37d9530c383, d3cab13d18cd4f498a9af6678eb8159e; no voters:
I20260619 04:39:12.810295 11749 raft_consensus.cc:2781] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:12.810436 11749 raft_consensus.cc:482] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:12.810552 11749 raft_consensus.cc:3037] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:12.812601 11749 raft_consensus.cc:504] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.813201 11749 leader_election.cc:288] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [CANDIDATE]: Term 1 election: Requested vote from peers d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65:42163), 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831)
I20260619 04:39:12.813702 11396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7842e97037e4b95b49c4f6977eef8aa" candidate_uuid: "a1d118f35c674406aae9c37d9530c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cab13d18cd4f498a9af6678eb8159e"
I20260619 04:39:12.813755 11538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7842e97037e4b95b49c4f6977eef8aa" candidate_uuid: "a1d118f35c674406aae9c37d9530c383" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7549928b3f5c40b88cc65f506de4a698"
I20260619 04:39:12.813908 11396 raft_consensus.cc:3037] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:12.813970 11538 raft_consensus.cc:3037] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:12.816557 11396 raft_consensus.cc:2454] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1d118f35c674406aae9c37d9530c383 in term 1.
I20260619 04:39:12.816960 11604 leader_election.cc:302] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1d118f35c674406aae9c37d9530c383, d3cab13d18cd4f498a9af6678eb8159e; no voters:
I20260619 04:39:12.817183 11538 raft_consensus.cc:2454] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1d118f35c674406aae9c37d9530c383 in term 1.
I20260619 04:39:12.817261 11749 raft_consensus.cc:2781] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:12.817796 11749 raft_consensus.cc:686] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 1 LEADER]: Becoming Leader. State: Replica: a1d118f35c674406aae9c37d9530c383, State: Running, Role: LEADER
I20260619 04:39:12.818208 11749 consensus_queue.cc:237] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.821942 11236 catalog_manager.cc:5495] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1d118f35c674406aae9c37d9530c383 (127.9.224.67). New cstate: current_term: 1 leader_uuid: "a1d118f35c674406aae9c37d9530c383" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } health_report { overall_health: HEALTHY } } }
Jun 19 04:39:12 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843950, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:12.870692 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.856598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57504 (local address 127.9.224.126:37327)
0619 04:39:12.856823 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:12.856831 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:12.857395 (+ 564us) server_negotiation.cc:407] Connection header received
0619 04:39:12.857591 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:12.857596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:12.857660 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:12.857755 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:12.859160 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.859898 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.861112 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.861523 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.861648 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.864999 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:12.865003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:12.865007 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:12.865033 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:12.867790 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.868562 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.868570 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.868573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.868704 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:12.869047 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:12.869054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:12.869058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:12.869376 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:12.869559 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:12.869952 (+ 393us) server_negotiation.cc:299] Negotiation successful
0619 04:39:12.870333 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":137,"server-negotiator.queue_time_us":65}
I20260619 04:39:12.870710 11779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:12.856629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:37327 (local address 127.0.0.1:57504)
0619 04:39:12.857281 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:12.857311 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:12.857470 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:12.857784 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:12.857788 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:12.858695 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:12.858994 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.859003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.860019 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.860028 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.860973 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:12.860984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:12.861701 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:12.861707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:12.861849 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:12.862626 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:12.862660 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:12.864823 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:12.867926 (+ 3103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:12.867938 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:12.867946 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:12.868454 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:12.868804 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:12.868810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:12.868814 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:12.868948 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:12.869506 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:12.869514 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:12.869688 (+ 174us) client_negotiation.cc:769] Sending connection context
0619 04:39:12.869844 (+ 156us) client_negotiation.cc:240] Negotiation successful
0619 04:39:12.870162 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":378,"threads_started":1}
I20260619 04:39:12.875759 11236 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:57504:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 04:39:12.876827 11236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:12.883736 11373 tablet_service.cc:1467] Processing CreateTablet for tablet c5693c86fcbd4a118eb1ea29dc6c31d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a003f42b907e4f199816238c32529904]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:39:12.884095 11512 tablet_service.cc:1467] Processing CreateTablet for tablet c5693c86fcbd4a118eb1ea29dc6c31d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a003f42b907e4f199816238c32529904]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:39:12.884351 11373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5693c86fcbd4a118eb1ea29dc6c31d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.884634 11512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5693c86fcbd4a118eb1ea29dc6c31d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.890003 11651 tablet_service.cc:1467] Processing CreateTablet for tablet c5693c86fcbd4a118eb1ea29dc6c31d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a003f42b907e4f199816238c32529904]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:39:12.890549 11651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5693c86fcbd4a118eb1ea29dc6c31d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:12.890573 11742 tablet_bootstrap.cc:492] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: Bootstrap starting.
I20260619 04:39:12.891747 11741 tablet_bootstrap.cc:492] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: Bootstrap starting.
I20260619 04:39:12.892284 11742 tablet_bootstrap.cc:654] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.893311 11741 tablet_bootstrap.cc:654] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.902915 11743 tablet_bootstrap.cc:492] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: Bootstrap starting.
I20260619 04:39:12.905138 11743 tablet_bootstrap.cc:654] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:12.905751 11741 tablet_bootstrap.cc:492] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: No bootstrap required, opened a new log
I20260619 04:39:12.905910 11741 ts_tablet_manager.cc:1397] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.011s
I20260619 04:39:12.906680 11741 raft_consensus.cc:348] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.906936 11741 raft_consensus.cc:374] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.907003 11741 raft_consensus.cc:729] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7549928b3f5c40b88cc65f506de4a698, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.907259 11741 consensus_queue.cc:260] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.907750 11748 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:12.908147 11748 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:12.908617 11741 ts_tablet_manager.cc:1428] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:12.914873 11743 tablet_bootstrap.cc:492] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: No bootstrap required, opened a new log
I20260619 04:39:12.914932 11742 tablet_bootstrap.cc:492] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: No bootstrap required, opened a new log
I20260619 04:39:12.915081 11743 ts_tablet_manager.cc:1397] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20260619 04:39:12.915105 11742 ts_tablet_manager.cc:1397] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.013s
I20260619 04:39:12.915707 11743 raft_consensus.cc:348] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.915957 11743 raft_consensus.cc:374] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.915927 11742 raft_consensus.cc:348] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.916066 11743 raft_consensus.cc:729] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d118f35c674406aae9c37d9530c383, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.916173 11742 raft_consensus.cc:374] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:12.916252 11742 raft_consensus.cc:729] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cab13d18cd4f498a9af6678eb8159e, State: Initialized, Role: FOLLOWER
I20260619 04:39:12.916340 11743 consensus_queue.cc:260] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.916484 11742 consensus_queue.cc:260] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.916810 11749 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:12.917150 11742 ts_tablet_manager.cc:1428] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 04:39:12.916955 11760 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:12.917348 11760 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:12.918010 11749 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:12.918344 11743 ts_tablet_manager.cc:1428] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 04:39:12.992370 11760 raft_consensus.cc:482] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:12.992592 11760 raft_consensus.cc:504] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.993353 11760 leader_election.cc:288] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831), a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361)
I20260619 04:39:12.994033 11672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5693c86fcbd4a118eb1ea29dc6c31d8" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d118f35c674406aae9c37d9530c383" is_pre_election: true
I20260619 04:39:12.994073 11538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5693c86fcbd4a118eb1ea29dc6c31d8" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7549928b3f5c40b88cc65f506de4a698" is_pre_election: true
I20260619 04:39:12.994385 11672 raft_consensus.cc:2454] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 0.
I20260619 04:39:12.994408 11538 raft_consensus.cc:2454] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 0.
I20260619 04:39:12.994904 11324 leader_election.cc:302] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7549928b3f5c40b88cc65f506de4a698, d3cab13d18cd4f498a9af6678eb8159e; no voters:
I20260619 04:39:12.995213 11760 raft_consensus.cc:2781] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:12.995361 11760 raft_consensus.cc:482] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:12.995501 11760 raft_consensus.cc:3037] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:12.998528 11760 raft_consensus.cc:504] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:12.999257 11760 leader_election.cc:288] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 election: Requested vote from peers 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831), a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361)
I20260619 04:39:12.999903 11672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5693c86fcbd4a118eb1ea29dc6c31d8" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d118f35c674406aae9c37d9530c383"
I20260619 04:39:13.000005 11538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5693c86fcbd4a118eb1ea29dc6c31d8" candidate_uuid: "d3cab13d18cd4f498a9af6678eb8159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7549928b3f5c40b88cc65f506de4a698"
I20260619 04:39:13.000165 11672 raft_consensus.cc:3037] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:13.000284 11538 raft_consensus.cc:3037] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:13.002867 11538 raft_consensus.cc:2454] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 1.
I20260619 04:39:13.003324 11324 leader_election.cc:302] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7549928b3f5c40b88cc65f506de4a698, d3cab13d18cd4f498a9af6678eb8159e; no voters:
I20260619 04:39:13.003382 11672 raft_consensus.cc:2454] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cab13d18cd4f498a9af6678eb8159e in term 1.
I20260619 04:39:13.003821 11760 raft_consensus.cc:2781] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:13.004010 11760 raft_consensus.cc:686] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [term 1 LEADER]: Becoming Leader. State: Replica: d3cab13d18cd4f498a9af6678eb8159e, State: Running, Role: LEADER
I20260619 04:39:13.004328 11760 consensus_queue.cc:237] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } }
I20260619 04:39:13.006335 11752 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: TxnStatusTablet state changed. Reason: New leader d3cab13d18cd4f498a9af6678eb8159e. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.006735 11752 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:39:13.007539 11784 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 04:39:13.007824 11784 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 04:39:13.008018 11236 catalog_manager.cc:5495] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65). New cstate: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260619 04:39:13.027719 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.021764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.9.224.65:42163)
0619 04:39:13.021950 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.021955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.022048 (+ 93us) server_negotiation.cc:407] Connection header received
0619 04:39:13.022375 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.022378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.022442 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.022518 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:13.022979 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.023798 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.025797 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.026379 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.026485 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.027017 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.027132 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.027201 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.027390 (+ 189us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.027455 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:39:13.027899 11779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.021689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:42163 (local address 127.0.0.1:59326)
0619 04:39:13.021944 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:13.021970 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:13.022156 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:13.022580 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:13.022586 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:13.022601 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:13.022828 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:13.022842 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.023940 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.023948 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:13.025604 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:13.025626 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.026535 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.026542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:13.026757 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.026843 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.027236 (+ 393us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.027263 (+ 27us) client_negotiation.cc:769] Sending connection context
0619 04:39:13.027364 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 04:39:13.027536 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260619 04:39:13.032040 11672 raft_consensus.cc:1261] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Refusing update from remote peer d3cab13d18cd4f498a9af6678eb8159e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:13.032034 11538 raft_consensus.cc:1261] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Refusing update from remote peer d3cab13d18cd4f498a9af6678eb8159e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:13.032819 11760 consensus_queue.cc:1035] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:13.033303 11752 consensus_queue.cc:1035] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:13.036729 11749 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: TxnStatusTablet state changed. Reason: New leader d3cab13d18cd4f498a9af6678eb8159e. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.037045 11749 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:13.039117 11752 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.039413 11752 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:39:13.045051 11749 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.045475 11749 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P a1d118f35c674406aae9c37d9530c383: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:13.052352 11748 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: TxnStatusTablet state changed. Reason: New leader d3cab13d18cd4f498a9af6678eb8159e. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.052702 11748 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:13.053444 11760 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.053762 11760 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P d3cab13d18cd4f498a9af6678eb8159e: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:39:13.057612 11736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.048218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.9.224.67:46361)
0619 04:39:13.048469 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.048478 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.048503 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:39:13.048618 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.048627 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.048761 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.048963 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:13.049474 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.050677 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.052540 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.053190 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.053330 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.054409 (+ 1079us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.056852 (+ 2443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.057021 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.057165 (+ 144us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.057264 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260619 04:39:13.058444 11748 tablet_replica.cc:439] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d3cab13d18cd4f498a9af6678eb8159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 } } peers { permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 } } peers { permanent_uuid: "a1d118f35c674406aae9c37d9530c383" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46361 } } }
I20260619 04:39:13.058701 11748 tablet_replica.cc:442] T c5693c86fcbd4a118eb1ea29dc6c31d8 P 7549928b3f5c40b88cc65f506de4a698: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:13.075477 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.069467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:42611 (local address 127.9.224.65:42163)
0619 04:39:13.069653 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.069657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.070389 (+ 732us) server_negotiation.cc:407] Connection header received
0619 04:39:13.070658 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.070662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.070730 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.070848 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:13.071380 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.072188 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.073601 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.074064 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.074202 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.074678 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.074797 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.074903 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.075045 (+ 142us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.075122 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:39:13.075526 11790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.069472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:42163 (local address 127.9.224.67:42611)
0619 04:39:13.070275 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:13.070294 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:13.070474 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:13.070861 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:13.070866 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:13.070878 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:13.071223 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:13.071232 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.072321 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.072329 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:13.073442 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:13.073452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.074291 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.074298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:13.074441 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.074498 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.074901 (+ 403us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.074913 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 04:39:13.075011 (+ 98us) client_negotiation.cc:240] Negotiation successful
0619 04:39:13.075151 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":365,"threads_started":1}
I20260619 04:39:13.085530 11538 raft_consensus.cc:1261] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Refusing update from remote peer a1d118f35c674406aae9c37d9530c383: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:13.085803 11396 raft_consensus.cc:1261] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Refusing update from remote peer a1d118f35c674406aae9c37d9530c383: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:13.086310 11772 consensus_queue.cc:1035] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7549928b3f5c40b88cc65f506de4a698" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:13.087200 11772 consensus_queue.cc:1035] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cab13d18cd4f498a9af6678eb8159e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:13.127698 11736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.119901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:57673 (local address 127.9.224.67:46361)
0619 04:39:13.120056 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.120078 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.120864 (+ 786us) server_negotiation.cc:407] Connection header received
0619 04:39:13.121088 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.121094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.121203 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.121295 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:13.122174 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.123323 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.125644 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.126320 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.126438 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.127034 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.127134 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.127199 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.127398 (+ 199us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.127458 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 04:39:13.127978 11794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.119950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:46361 (local address 127.9.224.65:57673)
0619 04:39:13.120760 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:13.120776 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:13.120942 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:13.121337 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:13.121343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:13.121359 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:13.121784 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:13.121805 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.123547 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.123553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:13.125484 (+ 1931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:13.125501 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.126543 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.126552 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:13.126772 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.126861 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:13.127247 (+ 386us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:13.127267 (+ 20us) client_negotiation.cc:769] Sending connection context
0619 04:39:13.127378 (+ 111us) client_negotiation.cc:240] Negotiation successful
0619 04:39:13.127535 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":471,"threads_started":1}
I20260619 04:39:13.176360 11235 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:13.176656 11235 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:13.180616 11235 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 236a365e1ef544358d06a60a075c9633: Sending DeleteTablet for 3 replicas of tablet c7842e97037e4b95b49c4f6977eef8aa
I20260619 04:39:13.181874 11512 tablet_service.cc:1514] Processing DeleteTablet for tablet c7842e97037e4b95b49c4f6977eef8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:13 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60770
I20260619 04:39:13.181905 11373 tablet_service.cc:1514] Processing DeleteTablet for tablet c7842e97037e4b95b49c4f6977eef8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:13 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:59300
I20260619 04:39:13.182195 11765 tablet_replica.cc:330] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: stopping tablet replica
I20260619 04:39:13.182216 11766 tablet_replica.cc:330] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: stopping tablet replica
I20260619 04:39:13.182421 11765 raft_consensus.cc:2229] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:13.182462 11766 raft_consensus.cc:2229] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:13.182665 11765 raft_consensus.cc:2258] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:13.182695 11766 raft_consensus.cc:2258] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:13.184015 11766 ts_tablet_manager.cc:1905] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:13.184109 11651 tablet_service.cc:1514] Processing DeleteTablet for tablet c7842e97037e4b95b49c4f6977eef8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:13 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42760
I20260619 04:39:13.184491 11767 tablet_replica.cc:330] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: stopping tablet replica
I20260619 04:39:13.184784 11767 raft_consensus.cc:2229] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:13.185457 11767 raft_consensus.cc:2258] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:13.187091 11765 ts_tablet_manager.cc:1905] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:13.191510 11767 ts_tablet_manager.cc:1905] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:13.203387 11765 ts_tablet_manager.cc:1918] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:13.210457 11765 log.cc:1196] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/c7842e97037e4b95b49c4f6977eef8aa
I20260619 04:39:13.211032 11765 ts_tablet_manager.cc:1939] T c7842e97037e4b95b49c4f6977eef8aa P 7549928b3f5c40b88cc65f506de4a698: Deleting consensus metadata
I20260619 04:39:13.212405 11221 catalog_manager.cc:4841] TS 7549928b3f5c40b88cc65f506de4a698 (127.9.224.66:36831): tablet c7842e97037e4b95b49c4f6977eef8aa (table test-table [id=45e926a1b3c448bebaeeaa8a0d1c6030]) successfully deleted
I20260619 04:39:13.213583 11766 ts_tablet_manager.cc:1918] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:13.213852 11766 log.cc:1196] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/c7842e97037e4b95b49c4f6977eef8aa
I20260619 04:39:13.214527 11766 ts_tablet_manager.cc:1939] T c7842e97037e4b95b49c4f6977eef8aa P d3cab13d18cd4f498a9af6678eb8159e: Deleting consensus metadata
I20260619 04:39:13.214689 11767 ts_tablet_manager.cc:1918] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:13.214910 11767 log.cc:1196] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/c7842e97037e4b95b49c4f6977eef8aa
I20260619 04:39:13.216418 11767 ts_tablet_manager.cc:1939] T c7842e97037e4b95b49c4f6977eef8aa P a1d118f35c674406aae9c37d9530c383: Deleting consensus metadata
I20260619 04:39:13.217386 11222 catalog_manager.cc:4841] TS d3cab13d18cd4f498a9af6678eb8159e (127.9.224.65:42163): tablet c7842e97037e4b95b49c4f6977eef8aa (table test-table [id=45e926a1b3c448bebaeeaa8a0d1c6030]) successfully deleted
I20260619 04:39:13.218622 11221 catalog_manager.cc:4841] TS a1d118f35c674406aae9c37d9530c383 (127.9.224.67:46361): tablet c7842e97037e4b95b49c4f6977eef8aa (table test-table [id=45e926a1b3c448bebaeeaa8a0d1c6030]) successfully deleted
Jun 19 04:39:13 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:13.234139 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.198745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.9.224.65:42163)
0619 04:39:13.198967 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.198974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.205898 (+ 6924us) server_negotiation.cc:407] Connection header received
0619 04:39:13.206175 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.206182 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.206294 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.206425 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:13.215116 (+ 8691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.216354 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.218498 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.219198 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.219327 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.225302 (+ 5975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:13.225322 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:13.225344 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:13.225414 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:13.230143 (+ 4729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.231162 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.231177 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.231184 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.231376 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.231859 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.231866 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.231876 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.232430 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:13.232806 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.233168 (+ 362us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.233425 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260619 04:39:13.235072 11439 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59336
I20260619 04:39:13.257869 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.239533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57516 (local address 127.9.224.126:37327)
0619 04:39:13.239764 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.239772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.240275 (+ 503us) server_negotiation.cc:407] Connection header received
0619 04:39:13.240476 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.240483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.240581 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.240703 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:13.242718 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.243920 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.245988 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.246857 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.246994 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.250667 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:13.250675 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:13.250681 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:13.250728 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:13.254638 (+ 3910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.255540 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.255547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.255550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.255711 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.256167 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.256173 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.256177 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.256563 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:13.256851 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.257216 (+ 365us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.257469 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260619 04:39:13.258576 11235 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57516
I20260619 04:39:13.261178 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11308
I20260619 04:39:13.284494 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.262548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59340 (local address 127.9.224.65:42163)
0619 04:39:13.263115 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.263122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.266767 (+ 3645us) server_negotiation.cc:407] Connection header received
0619 04:39:13.266955 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.266962 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.267068 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.267178 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:13.268847 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.270349 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.272289 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.273190 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.273337 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.276613 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:13.276621 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:13.276626 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:13.276673 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:13.280862 (+ 4189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.281775 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.281782 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.281786 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.281961 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.282481 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.282487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.282491 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.282879 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:13.283204 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.283542 (+ 338us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.283805 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412}
W20260619 04:39:13.285207 11439 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59340
W20260619 04:39:13.285863 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11308: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:13.286068 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11308
I20260619 04:39:13.308583 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11448
Jun 19 04:39:13 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:13.326422 11802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.309574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60774 (local address 127.9.224.66:36831)
0619 04:39:13.310018 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.310023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.310042 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:39:13.310101 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.310105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.310169 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.310341 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:13.311949 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.312650 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.314693 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.315117 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.315222 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.320543 (+ 5321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:13.320557 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:13.320573 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:13.320611 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:13.323587 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.324451 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.324458 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.324461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.324592 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.324989 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.324992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.324994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.325320 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:13.325522 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.325888 (+ 366us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.326056 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":244,"threads_started":1}
W20260619 04:39:13.327193 11578 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60774
W20260619 04:39:13.327944 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11448: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:13.328154 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11448
I20260619 04:39:13.345327 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11587
Jun 19 04:39:13 dist-test-slave-9dgf krb5kdc[11192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:13.363451 11736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:13.346383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42792 (local address 127.9.224.67:46361)
0619 04:39:13.346619 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:13.346626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:13.346649 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:39:13.346718 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:13.346724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:13.346816 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:13.346932 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:13.348189 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.349508 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.350768 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:13.351529 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:13.351679 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:13.355757 (+ 4078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:13.355776 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:13.355799 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:13.355848 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:13.360127 (+ 4279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.360996 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.361006 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.361010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.361232 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:13.361666 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:13.361672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:13.361677 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:13.362174 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:13.362625 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:13.362794 (+ 169us) server_negotiation.cc:299] Negotiation successful
0619 04:39:13.363063 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260619 04:39:13.364289 11717 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42792
W20260619 04:39:13.365056 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11587: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:13.365222 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11587
I20260619 04:39:13.386198 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11205
I20260619 04:39:13.387359 11277 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:13.501688 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11205
2026-06-19T04:39:13Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4573 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:13 dist-test-slave-9dgf krb5kdc[11806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:13 dist-test-slave-9dgf krb5kdc[11806](info): set up 2 sockets
Jun 19 04:39:13 dist-test-slave-9dgf krb5kdc[11806](info): commencing operation
krb5kdc: starting...
W20260619 04:39:14.586349 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:14 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:14.782166 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:44131
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:44131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:15.097132 11819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:15.097476 11819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:15.097656 11819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:15.104717 11819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:15.104859 11819 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 04:39:15.104956 11819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:15.105079 11819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:15.105173 11819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:15.105259 11819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:15.114854 11819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:44131
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:44131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:15.116209 11819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:15.117558 11819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:15.129079 11824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:15.129351 11825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:15.129388 11827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:15.130620 11819 server_base.cc:1034] running on GCE node
I20260619 04:39:15.131469 11819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:15.132822 11819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:15.134066 11819 hybrid_clock.cc:648] HybridClock initialized: now 1781843955133987 us; error 49 us; skew 500 ppm
I20260619 04:39:15.134517 11819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:15 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843955, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:15.137707 11819 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:15.139313 11819 webserver.cc:460] Webserver started at http://127.9.224.126:42051/ using document root <none> and password file <none>
I20260619 04:39:15.140012 11819 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:15.140096 11819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:15.140365 11819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:15.143368 11819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "9d2be47dac234c6b91d59313a837af47"
format_stamp: "Formatted at 2026-06-19 04:39:15 on dist-test-slave-9dgf"
server_key: "e8ab07c10be14c2f201342e571116cda"
server_key_iv: "bf9938c64bbfdc674b03831f6dc158f5"
server_key_version: "encryptionkey@0"
I20260619 04:39:15.144088 11819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "9d2be47dac234c6b91d59313a837af47"
format_stamp: "Formatted at 2026-06-19 04:39:15 on dist-test-slave-9dgf"
server_key: "e8ab07c10be14c2f201342e571116cda"
server_key_iv: "bf9938c64bbfdc674b03831f6dc158f5"
server_key_version: "encryptionkey@0"
I20260619 04:39:15.149122 11819 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:39:15.152593 11834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:15.153903 11819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:15.154034 11819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "9d2be47dac234c6b91d59313a837af47"
format_stamp: "Formatted at 2026-06-19 04:39:15 on dist-test-slave-9dgf"
server_key: "e8ab07c10be14c2f201342e571116cda"
server_key_iv: "bf9938c64bbfdc674b03831f6dc158f5"
server_key_version: "encryptionkey@0"
I20260619 04:39:15.154206 11819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:15.175338 11819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:15.179494 11819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:15.179705 11819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:15.200896 11819 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:44131
I20260619 04:39:15.200915 11895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:44131 every 8 connection(s)
I20260619 04:39:15.202248 11819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:15.206034 11896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:15.209795 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11819
I20260619 04:39:15.210016 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:15.210852 10113 external_mini_cluster.cc:1428] Setting key c2812deb21cb66050a3968cf5b3b46f0
I20260619 04:39:15.217969 11896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Bootstrap starting.
I20260619 04:39:15.221621 11896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:15.222820 11896 log.cc:824] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:15.225543 11896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: No bootstrap required, opened a new log
Jun 19 04:39:15 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:15.234635 11896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2be47dac234c6b91d59313a837af47" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44131 } }
I20260619 04:39:15.235033 11899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:15.213226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50918 (local address 127.9.224.126:44131)
0619 04:39:15.214121 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:15.214133 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:15.214181 (+ 48us) server_negotiation.cc:407] Connection header received
0619 04:39:15.216630 (+ 2449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:15.216654 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:15.217071 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:15.217411 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:15.219184 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.220620 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.222371 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.223104 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.223232 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:15.227728 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:15.227736 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:15.227750 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:15.227792 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:15.230937 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:15.231721 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:15.231727 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:15.231733 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:15.231896 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:15.232282 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:15.232285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:15.232287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:15.232813 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:15.233031 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:15.233498 (+ 467us) server_negotiation.cc:299] Negotiation successful
0619 04:39:15.233893 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":436,"threads_started":1}
I20260619 04:39:15.235011 11896 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:15.235200 11896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2be47dac234c6b91d59313a837af47, State: Initialized, Role: FOLLOWER
I20260619 04:39:15.235824 11896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2be47dac234c6b91d59313a837af47" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44131 } }
I20260619 04:39:15.236027 11896 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:15.236119 11896 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:15.236276 11896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:15.239136 11896 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2be47dac234c6b91d59313a837af47" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44131 } }
I20260619 04:39:15.239687 11896 leader_election.cc:302] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d2be47dac234c6b91d59313a837af47; no voters:
I20260619 04:39:15.240357 11896 leader_election.cc:288] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:15.240430 11901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:15.241128 11901 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [term 1 LEADER]: Becoming Leader. State: Replica: 9d2be47dac234c6b91d59313a837af47, State: Running, Role: LEADER
I20260619 04:39:15.241652 11901 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2be47dac234c6b91d59313a837af47" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44131 } }
I20260619 04:39:15.242523 11896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:15.244585 11902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d2be47dac234c6b91d59313a837af47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2be47dac234c6b91d59313a837af47" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44131 } } }
I20260619 04:39:15.245087 11902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:15.245154 11903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d2be47dac234c6b91d59313a837af47. Latest consensus state: current_term: 1 leader_uuid: "9d2be47dac234c6b91d59313a837af47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2be47dac234c6b91d59313a837af47" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44131 } } }
I20260619 04:39:15.245445 11903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:15.247401 11909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:15.252830 11909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:15.262264 11909 catalog_manager.cc:1347] Generated new cluster ID: fabf0eb11a884370bfef663443732e95
I20260619 04:39:15.262382 11909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:15.287142 11909 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:15.288834 11909 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:15.298792 11909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Generated new TSK 0
I20260619 04:39:15.299674 11909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:15.361879 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44131
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:15.703771 11922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:15.704110 11922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:15.704293 11922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:15.711733 11922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:15.711899 11922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:15.712070 11922 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 04:39:15.712162 11922 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:39:15.712306 11922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:15.722270 11922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:44131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:15.723706 11922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:15.725252 11922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:15.739041 11927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:15.739099 11928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:15.739120 11930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:15.740412 11922 server_base.cc:1034] running on GCE node
I20260619 04:39:15.741027 11922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:15.741953 11922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:15.743247 11922 hybrid_clock.cc:648] HybridClock initialized: now 1781843955743124 us; error 106 us; skew 500 ppm
I20260619 04:39:15.743683 11922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:15 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843955, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:15.747076 11922 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:15.748771 11922 webserver.cc:460] Webserver started at http://127.9.224.65:42407/ using document root <none> and password file <none>
I20260619 04:39:15.749549 11922 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:15.749683 11922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:15.750023 11922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:15.753286 11922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "be851e35e66f407a9817fd0b74f15a2b"
format_stamp: "Formatted at 2026-06-19 04:39:15 on dist-test-slave-9dgf"
server_key: "c57e201540eb1b32c34c7465883bc99c"
server_key_iv: "1d8dd51ecfffcbc0f245e4f41fc73fbe"
server_key_version: "encryptionkey@0"
I20260619 04:39:15.754514 11922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "be851e35e66f407a9817fd0b74f15a2b"
format_stamp: "Formatted at 2026-06-19 04:39:15 on dist-test-slave-9dgf"
server_key: "c57e201540eb1b32c34c7465883bc99c"
server_key_iv: "1d8dd51ecfffcbc0f245e4f41fc73fbe"
server_key_version: "encryptionkey@0"
I20260619 04:39:15.760303 11922 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:39:15.764038 11937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:15.765395 11922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:39:15.765558 11922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "be851e35e66f407a9817fd0b74f15a2b"
format_stamp: "Formatted at 2026-06-19 04:39:15 on dist-test-slave-9dgf"
server_key: "c57e201540eb1b32c34c7465883bc99c"
server_key_iv: "1d8dd51ecfffcbc0f245e4f41fc73fbe"
server_key_version: "encryptionkey@0"
I20260619 04:39:15.765782 11922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:15.782130 11922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:15.786664 11922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:15.786969 11922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:15.789837 11922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:15.789990 11922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:15.790128 11922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:15.790252 11922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:39:15 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843955, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:15.813879 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:15.790504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:53743 (local address 127.9.224.126:44131)
0619 04:39:15.792790 (+ 2286us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:15.792797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:15.792858 (+ 61us) server_negotiation.cc:407] Connection header received
0619 04:39:15.794451 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:15.794457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:15.794560 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:15.794688 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:15.797019 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.797986 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.800651 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.801521 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.801684 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:15.807209 (+ 5525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:15.807215 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:15.807218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:15.807252 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:15.809797 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:15.810959 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:15.810967 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:15.810972 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:15.811113 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:15.811785 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:15.811790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:15.811793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:15.812219 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:15.812368 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:15.813307 (+ 939us) server_negotiation.cc:299] Negotiation successful
0619 04:39:15.813531 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2155,"thread_start_us":2045,"threads_started":1}
I20260619 04:39:15.815442 11947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:15.791108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.9.224.65:53743)
0619 04:39:15.792069 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:15.792122 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:15.794098 (+ 1976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:15.794955 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:15.794962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:15.795771 (+ 809us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:15.796830 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:15.796866 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.798153 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.798161 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:15.800456 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:15.800468 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.801856 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.801865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:15.802118 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:15.803081 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:15.803128 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:15.806935 (+ 3807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:15.809953 (+ 3018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:15.809966 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:15.809991 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:15.810794 (+ 803us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:15.811239 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:15.811244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:15.811248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:15.811639 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:15.812339 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:15.812347 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:15.812914 (+ 567us) client_negotiation.cc:769] Sending connection context
0619 04:39:15.813214 (+ 300us) client_negotiation.cc:240] Negotiation successful
0619 04:39:15.813761 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":362,"threads_started":1}
I20260619 04:39:15.843432 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:15.825283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:41083 (local address 127.9.224.126:44131)
0619 04:39:15.825489 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:15.825496 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:15.827075 (+ 1579us) server_negotiation.cc:407] Connection header received
0619 04:39:15.827375 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:15.827384 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:15.827481 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:15.827559 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:15.829659 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.830634 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.832708 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.833443 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.833604 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:15.836018 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:15.836028 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:15.836035 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:15.836089 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:15.840029 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:15.841145 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:15.841151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:15.841155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:15.841329 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:15.841793 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:15.841799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:15.841803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:15.842203 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:15.842375 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:15.842829 (+ 454us) server_negotiation.cc:299] Negotiation successful
0619 04:39:15.843062 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:15.843619 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:15.825272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.9.224.65:41083)
0619 04:39:15.826885 (+ 1613us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:15.826912 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:15.827167 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:15.827854 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:15.827862 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:15.828762 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:15.829431 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:15.829457 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.830875 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.830883 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:15.832548 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:15.832565 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:15.833653 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:15.833658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:15.833765 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:15.834587 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:15.834611 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:15.835761 (+ 1150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:15.840213 (+ 4452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:15.840222 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:15.840226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:15.840948 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:15.841486 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:15.841491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:15.841496 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:15.841673 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:15.842340 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:15.842350 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:15.842555 (+ 205us) client_negotiation.cc:769] Sending connection context
0619 04:39:15.842710 (+ 155us) client_negotiation.cc:240] Negotiation successful
0619 04:39:15.843123 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1389,"thread_start_us":1028,"threads_started":1}
I20260619 04:39:15.850513 11922 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:33711
I20260619 04:39:15.850564 12057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:33711 every 8 connection(s)
I20260619 04:39:15.851751 11922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:15.853770 12058 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44131
I20260619 04:39:15.854000 12058 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:15.854405 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 11922
I20260619 04:39:15.854605 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:15.854805 12058 heartbeater.cc:511] Master 127.9.224.126:44131 requested a full tablet report, sending...
I20260619 04:39:15.855275 10113 external_mini_cluster.cc:1428] Setting key ef540a3f6ac13118e9665e4fa211e3b6
I20260619 04:39:15.856809 11851 ts_manager.cc:194] Registered new tserver with Master: be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711)
I20260619 04:39:15.858880 11851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:53743
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:15.896926 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44131
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:16.225455 12062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:16.225739 12062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:16.225844 12062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:16.233340 12062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:16.233460 12062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:16.233547 12062 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 04:39:16.233600 12062 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:39:16.233668 12062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:16.243717 12062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:44131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:16.244980 12062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:16.246272 12062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:16.260556 12067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:16.260623 12068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:16.260650 12070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:16.261572 12062 server_base.cc:1034] running on GCE node
I20260619 04:39:16.262172 12062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:16.263149 12062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:16.264389 12062 hybrid_clock.cc:648] HybridClock initialized: now 1781843956264338 us; error 45 us; skew 500 ppm
I20260619 04:39:16.264659 12062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:16 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843956, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:16.267748 12062 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:16.269245 12062 webserver.cc:460] Webserver started at http://127.9.224.66:40897/ using document root <none> and password file <none>
I20260619 04:39:16.269984 12062 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:16.270087 12062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:16.270416 12062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:16.273413 12062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "d9977fb8e38c47d08d3494f17fd7b976"
format_stamp: "Formatted at 2026-06-19 04:39:16 on dist-test-slave-9dgf"
server_key: "afd6f2203cb25db046a7cf1000b19b3e"
server_key_iv: "48a554a6bca7817c39a55a436988f133"
server_key_version: "encryptionkey@0"
I20260619 04:39:16.274219 12062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "d9977fb8e38c47d08d3494f17fd7b976"
format_stamp: "Formatted at 2026-06-19 04:39:16 on dist-test-slave-9dgf"
server_key: "afd6f2203cb25db046a7cf1000b19b3e"
server_key_iv: "48a554a6bca7817c39a55a436988f133"
server_key_version: "encryptionkey@0"
I20260619 04:39:16.279369 12062 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:39:16.282932 12077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:16.284471 12062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:16.284646 12062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "d9977fb8e38c47d08d3494f17fd7b976"
format_stamp: "Formatted at 2026-06-19 04:39:16 on dist-test-slave-9dgf"
server_key: "afd6f2203cb25db046a7cf1000b19b3e"
server_key_iv: "48a554a6bca7817c39a55a436988f133"
server_key_version: "encryptionkey@0"
I20260619 04:39:16.284871 12062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:16.301069 12062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:16.305382 12062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:16.305611 12062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:16.308198 12062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:16.308343 12062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:16.308472 12062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:16.308573 12062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:39:16 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843956, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:16.334730 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.308591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:57209 (local address 127.9.224.126:44131)
0619 04:39:16.308772 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.308778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.310306 (+ 1528us) server_negotiation.cc:407] Connection header received
0619 04:39:16.312379 (+ 2073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.312389 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.312491 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.312605 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:16.315069 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.315766 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.319183 (+ 3417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.319870 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.320036 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.326013 (+ 5977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:16.326022 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:16.326030 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:16.326080 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:16.329175 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.330045 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.330053 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.330059 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.330221 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.330895 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.330901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.330905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.331332 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:16.331498 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.333960 (+ 2462us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.334244 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:39:16.335315 12086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.309248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.9.224.66:57209)
0619 04:39:16.310113 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.310161 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.312068 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.312873 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.312881 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.313663 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:16.314859 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.314888 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.315943 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.315948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.319004 (+ 3056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.319022 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.320172 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.320181 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.320624 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.321561 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:16.321597 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:16.325708 (+ 4111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:16.329314 (+ 3606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.329325 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.329350 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.329914 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.330396 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.330403 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.330411 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.330731 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.331583 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:16.331594 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:16.332161 (+ 567us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.332555 (+ 394us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.333245 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":369,"threads_started":1}
I20260619 04:39:16.356873 12062 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:39807
I20260619 04:39:16.357000 12196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:39807 every 8 connection(s)
I20260619 04:39:16.358637 12062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:16.359825 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.342875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.9.224.66:38499)
0619 04:39:16.343680 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.343708 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.343889 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.344298 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.344305 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.345105 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:16.345534 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.345546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.346949 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.346960 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.349014 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.349035 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.350001 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.350008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.350193 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.351045 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:16.351061 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:16.352259 (+ 1198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:16.356421 (+ 4162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.356428 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.356433 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.357201 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.357648 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.357652 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.357654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.357863 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.358648 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:16.358652 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:16.358854 (+ 202us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.358977 (+ 123us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.359340 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":447,"threads_started":1}
I20260619 04:39:16.359869 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.342631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:38499 (local address 127.9.224.126:44131)
0619 04:39:16.342851 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.342861 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.343807 (+ 946us) server_negotiation.cc:407] Connection header received
0619 04:39:16.344037 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.344044 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.344133 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.344236 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:16.345687 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.346789 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.349169 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.349800 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.349953 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.352499 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:16.352503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:16.352506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:16.352535 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:16.356267 (+ 3732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.357305 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.357310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.357313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.357483 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.358001 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.358005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.358009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.358477 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:16.358628 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.359122 (+ 494us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.359379 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260619 04:39:16.360872 12197 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44131
I20260619 04:39:16.361176 12197 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:16.362032 12197 heartbeater.cc:511] Master 127.9.224.126:44131 requested a full tablet report, sending...
I20260619 04:39:16.363479 11851 ts_manager.cc:194] Registered new tserver with Master: d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807)
I20260619 04:39:16.364287 11851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:57209
I20260619 04:39:16.365692 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 12062
I20260619 04:39:16.365870 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:16.366433 10113 external_mini_cluster.cc:1428] Setting key 85fcd80a1698779a6c8de53a2a9bb114
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:16.407298 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44131
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:16.727602 12201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:16.727949 12201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:16.728132 12201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:16.735759 12201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:16.735924 12201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:16.736070 12201 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 04:39:16.736178 12201 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:39:16.736292 12201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:16.750027 12201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:44131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:16.751399 12201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:16.752780 12201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:16.766623 12209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:16.766558 12207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:16.766593 12206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:16.767503 12201 server_base.cc:1034] running on GCE node
I20260619 04:39:16.768158 12201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:16.769186 12201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:16.770397 12201 hybrid_clock.cc:648] HybridClock initialized: now 1781843956770339 us; error 47 us; skew 500 ppm
I20260619 04:39:16.770709 12201 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:16 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843956, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:16.777911 12201 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:16.779592 12201 webserver.cc:460] Webserver started at http://127.9.224.67:33713/ using document root <none> and password file <none>
I20260619 04:39:16.780315 12201 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:16.780452 12201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:16.780781 12201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:16.783936 12201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "346119ed9cd74093ad3d2859d6855143"
format_stamp: "Formatted at 2026-06-19 04:39:16 on dist-test-slave-9dgf"
server_key: "e8b7b8c3a1d30b942468f19eba207011"
server_key_iv: "9e323bef6f249c21608a2e78e100c196"
server_key_version: "encryptionkey@0"
I20260619 04:39:16.784714 12201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "346119ed9cd74093ad3d2859d6855143"
format_stamp: "Formatted at 2026-06-19 04:39:16 on dist-test-slave-9dgf"
server_key: "e8b7b8c3a1d30b942468f19eba207011"
server_key_iv: "9e323bef6f249c21608a2e78e100c196"
server_key_version: "encryptionkey@0"
I20260619 04:39:16.790190 12201 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 04:39:16.793699 12216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:16.795318 12201 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:16.795475 12201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "346119ed9cd74093ad3d2859d6855143"
format_stamp: "Formatted at 2026-06-19 04:39:16 on dist-test-slave-9dgf"
server_key: "e8b7b8c3a1d30b942468f19eba207011"
server_key_iv: "9e323bef6f249c21608a2e78e100c196"
server_key_version: "encryptionkey@0"
I20260619 04:39:16.795650 12201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:16.815852 12201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:16.820218 12201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:16.820477 12201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:16.823305 12201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:16.823410 12201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:16.823580 12201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:16.823709 12201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:39:16 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843956, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:16.847819 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.823901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:60133 (local address 127.9.224.126:44131)
0619 04:39:16.824169 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.824177 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.825694 (+ 1517us) server_negotiation.cc:407] Connection header received
0619 04:39:16.827969 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.827974 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.828078 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.828189 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:16.830647 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.832029 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.834658 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.835177 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.835350 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.841305 (+ 5955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:16.841315 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:16.841322 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:16.841372 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:16.844486 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.845295 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.845301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.845306 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.845476 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.845914 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.845919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.845923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.846190 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:16.846379 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.847158 (+ 779us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.847389 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 04:39:16.848869 12225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.824568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.9.224.67:60133)
0619 04:39:16.825508 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.825557 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.827665 (+ 2108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.828604 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.828614 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.829471 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:16.830393 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.830419 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.832230 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.832238 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.834458 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.834474 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.835477 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.835486 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.835832 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.836689 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:16.836726 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:16.840994 (+ 4268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:16.844623 (+ 3629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.844633 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.844649 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.845163 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.845584 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.845590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.845593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.845796 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.846351 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:16.846358 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:16.846772 (+ 414us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.847032 (+ 260us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.847572 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":421,"threads_started":1}
I20260619 04:39:16.861819 12058 heartbeater.cc:503] Master 127.9.224.126:44131 was elected leader, sending a full tablet report...
I20260619 04:39:16.882828 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.854334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:46979 (local address 127.9.224.126:44131)
0619 04:39:16.854764 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.854770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.866958 (+ 12188us) server_negotiation.cc:407] Connection header received
0619 04:39:16.867174 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.867182 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.867280 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.867388 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:16.868580 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.869912 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.872571 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.873135 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.873286 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.876043 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:16.876052 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:16.876059 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:16.876112 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:16.879726 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.880780 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.880788 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.880791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.880946 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.881335 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.881340 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.881343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.881614 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:16.881761 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.882190 (+ 429us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.882458 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303}
I20260619 04:39:16.882942 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.854336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.9.224.67:46979)
0619 04:39:16.866831 (+ 12495us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.866855 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.867041 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.867593 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.867598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.868065 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:16.868411 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.868432 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.870120 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.870129 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.872376 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.872395 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.873636 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.873645 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.873899 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.874746 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:16.874763 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:16.875802 (+ 1039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:16.879877 (+ 4075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.879886 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.879902 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.880611 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.881063 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:16.881068 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:16.881073 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:16.881215 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:16.881732 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:16.881736 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:16.881924 (+ 188us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.882090 (+ 166us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.882485 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12325,"thread_start_us":12168,"threads_started":1}
I20260619 04:39:16.887275 12201 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:34319
I20260619 04:39:16.887420 12335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:34319 every 8 connection(s)
I20260619 04:39:16.888639 12201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:16.890677 12336 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44131
I20260619 04:39:16.890910 12336 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:16.891557 12336 heartbeater.cc:511] Master 127.9.224.126:44131 requested a full tablet report, sending...
I20260619 04:39:16.892834 11851 ts_manager.cc:194] Registered new tserver with Master: 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319)
I20260619 04:39:16.893635 11851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:60133
I20260619 04:39:16.896170 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 12201
I20260619 04:39:16.896353 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:16.896811 10113 external_mini_cluster.cc:1428] Setting key c29d92e98bf921be0e42dbb4900a5a3b
I20260619 04:39:16.899567 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 04:39:16 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 04:39:16 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:16.947613 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.933375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50920 (local address 127.9.224.126:44131)
0619 04:39:16.933611 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.933617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.933829 (+ 212us) server_negotiation.cc:407] Connection header received
0619 04:39:16.933948 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.933952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.934030 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.934119 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:16.935695 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.936491 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.937757 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.938367 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.938512 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.942403 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:16.942408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:16.942411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:16.942444 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:16.945055 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.945610 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.945613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.945615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.945736 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:16.946092 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:16.946095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:16.946097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:16.946489 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:16.946674 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.947078 (+ 404us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.947248 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260619 04:39:16.952118 11851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:16.959595 11851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:16.983799 12349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.972487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34319 (local address 127.0.0.1:60706)
0619 04:39:16.973518 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.973564 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.973775 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.975744 (+ 1969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.975753 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.975781 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:16.976222 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.976234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.978253 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.978259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.980487 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.980499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.982716 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.982727 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.982931 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.982988 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.983133 (+ 145us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.983339 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":3,"thread_start_us":578,"threads_started":1}
I20260619 04:39:16.984568 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.972818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60706 (local address 127.9.224.67:34319)
0619 04:39:16.975029 (+ 2211us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.975036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.975070 (+ 34us) server_negotiation.cc:407] Connection header received
0619 04:39:16.975176 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.975186 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.975509 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.976440 (+ 931us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:16.976770 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.978082 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.980645 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.982089 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.982264 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.982508 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.984053 (+ 1545us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.984230 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2001,"thread_start_us":1786,"threads_started":1}
I20260619 04:39:16.984611 12352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.973200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55820 (local address 127.9.224.65:33711)
0619 04:39:16.974395 (+ 1195us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.974409 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.975624 (+ 1215us) server_negotiation.cc:407] Connection header received
0619 04:39:16.975747 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.975759 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.976043 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.976340 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:16.977606 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.979218 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.981674 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.983035 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.983906 (+ 871us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.984119 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.984180 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.984327 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1002,"thread_start_us":872,"threads_started":1}
I20260619 04:39:16.985199 12350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.972704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:33711 (local address 127.0.0.1:55820)
0619 04:39:16.975333 (+ 2629us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.975354 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.975493 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.976616 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.976624 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.976659 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:16.977380 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.977398 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.979391 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.979397 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.981525 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.981537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.983275 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.983281 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.983442 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.983487 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.983553 (+ 66us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.983679 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2404,"mutex_wait_us":27,"thread_start_us":2244,"threads_started":1}
I20260619 04:39:16.986011 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.974752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54240 (local address 127.9.224.66:39807)
0619 04:39:16.978003 (+ 3251us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:16.978009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:16.978032 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:39:16.978100 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:16.978105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:16.978383 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:16.978587 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:16.979442 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.980932 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.983331 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.984503 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.984630 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.985030 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:16.985584 (+ 554us) server_negotiation.cc:299] Negotiation successful
0619 04:39:16.985757 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3099,"thread_start_us":3005,"threads_started":1}
I20260619 04:39:16.986047 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:16.974141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:39807 (local address 127.0.0.1:54240)
0619 04:39:16.975621 (+ 1480us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:16.975639 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:16.975742 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:16.978596 (+ 2854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:16.978601 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:16.978629 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:16.979228 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.979240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.981114 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.981119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.983117 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:16.983131 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:16.985202 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:16.985208 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:16.985397 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:16.985427 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 04:39:16.985539 (+ 112us) client_negotiation.cc:240] Negotiation successful
0619 04:39:16.985663 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1358,"mutex_wait_us":96,"thread_start_us":1183,"threads_started":1}
I20260619 04:39:16.988584 12266 tablet_service.cc:1467] Processing CreateTablet for tablet b2afb3d4ebc545d698bf4f74dea831a9 (DEFAULT_TABLE table=test-table [id=56ce64d4a9c24128b7218d1f8dfdc229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:16.989289 11988 tablet_service.cc:1467] Processing CreateTablet for tablet b2afb3d4ebc545d698bf4f74dea831a9 (DEFAULT_TABLE table=test-table [id=56ce64d4a9c24128b7218d1f8dfdc229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:16.990020 12266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2afb3d4ebc545d698bf4f74dea831a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:16.990479 11988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2afb3d4ebc545d698bf4f74dea831a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:16.992807 12127 tablet_service.cc:1467] Processing CreateTablet for tablet b2afb3d4ebc545d698bf4f74dea831a9 (DEFAULT_TABLE table=test-table [id=56ce64d4a9c24128b7218d1f8dfdc229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:16.994110 12127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2afb3d4ebc545d698bf4f74dea831a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.001884 12355 tablet_bootstrap.cc:492] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Bootstrap starting.
I20260619 04:39:17.004516 12356 tablet_bootstrap.cc:492] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Bootstrap starting.
I20260619 04:39:17.005548 12355 tablet_bootstrap.cc:654] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.006973 12355 log.cc:824] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:17.007957 12356 tablet_bootstrap.cc:654] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.008276 12358 tablet_bootstrap.cc:492] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Bootstrap starting.
I20260619 04:39:17.009130 12356 log.cc:824] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:17.009933 12355 tablet_bootstrap.cc:492] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: No bootstrap required, opened a new log
I20260619 04:39:17.010324 12355 ts_tablet_manager.cc:1397] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 04:39:17.013921 12358 tablet_bootstrap.cc:654] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.015424 12358 log.cc:824] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:17.017840 12356 tablet_bootstrap.cc:492] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: No bootstrap required, opened a new log
I20260619 04:39:17.018150 12356 ts_tablet_manager.cc:1397] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260619 04:39:17.018143 12355 raft_consensus.cc:348] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.018612 12355 raft_consensus.cc:374] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.018739 12355 raft_consensus.cc:729] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be851e35e66f407a9817fd0b74f15a2b, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.019348 12355 consensus_queue.cc:260] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.019717 12358 tablet_bootstrap.cc:492] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: No bootstrap required, opened a new log
I20260619 04:39:17.019970 12358 ts_tablet_manager.cc:1397] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260619 04:39:17.020902 12355 ts_tablet_manager.cc:1428] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260619 04:39:17.026835 12356 raft_consensus.cc:348] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.027226 12356 raft_consensus.cc:374] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.027336 12356 raft_consensus.cc:729] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.027961 12356 consensus_queue.cc:260] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.029031 12336 heartbeater.cc:503] Master 127.9.224.126:44131 was elected leader, sending a full tablet report...
I20260619 04:39:17.029613 12356 ts_tablet_manager.cc:1428] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Time spent starting tablet: real 0.011s user 0.003s sys 0.007s
I20260619 04:39:17.029961 12358 raft_consensus.cc:348] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.030426 12358 raft_consensus.cc:374] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.030544 12358 raft_consensus.cc:729] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.031183 12358 consensus_queue.cc:260] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.032230 12197 heartbeater.cc:503] Master 127.9.224.126:44131 was elected leader, sending a full tablet report...
I20260619 04:39:17.033007 12358 ts_tablet_manager.cc:1428] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
W20260619 04:39:17.104192 12059 tablet.cc:2369] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:39:17.111528 12198 tablet.cc:2369] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:39:17.140376 12337 tablet.cc:2369] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:17.189795 12363 raft_consensus.cc:482] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:17.190157 12363 raft_consensus.cc:504] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.192034 12363 leader_election.cc:288] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319), be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711)
I20260619 04:39:17.198961 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.192552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:35967 (local address 127.9.224.67:34319)
0619 04:39:17.192747 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.192752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.193472 (+ 720us) server_negotiation.cc:407] Connection header received
0619 04:39:17.193750 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.193755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.193817 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.193921 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:17.194560 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.195307 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.197153 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.197924 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.198122 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.198210 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.198517 (+ 307us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.198645 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:39:17.199103 12352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.192571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:42769 (local address 127.9.224.65:33711)
0619 04:39:17.192786 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.192794 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.193865 (+ 1071us) server_negotiation.cc:407] Connection header received
0619 04:39:17.194099 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.194103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.194161 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.194291 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:17.194855 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.195539 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.197332 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.198124 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.198330 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.198414 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.198682 (+ 268us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.198805 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:39:17.199148 12364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.192532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34319 (local address 127.9.224.66:35967)
0619 04:39:17.193341 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.193358 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.193563 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.193938 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.193942 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.193977 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:17.194410 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.194420 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.195450 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.195456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.196992 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.197004 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.198139 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.198146 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.198360 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.198385 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.198490 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.198634 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"mutex_wait_us":4,"thread_start_us":409,"threads_started":1}
I20260619 04:39:17.199198 12365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.192554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:33711 (local address 127.9.224.66:42769)
0619 04:39:17.193751 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.193765 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.193940 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.194320 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.194324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.194354 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:17.194704 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.194713 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.195682 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.195687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.197174 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.197186 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.198372 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.198378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.198522 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.198547 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.198646 (+ 99us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.198770 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"mutex_wait_us":44,"thread_start_us":883,"threads_started":1}
I20260619 04:39:17.200277 12010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2afb3d4ebc545d698bf4f74dea831a9" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b" is_pre_election: true
I20260619 04:39:17.200304 12291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2afb3d4ebc545d698bf4f74dea831a9" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346119ed9cd74093ad3d2859d6855143" is_pre_election: true
I20260619 04:39:17.200896 12010 raft_consensus.cc:2454] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 0.
I20260619 04:39:17.200881 12291 raft_consensus.cc:2454] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 0.
I20260619 04:39:17.201645 12079 leader_election.cc:302] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, be851e35e66f407a9817fd0b74f15a2b, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:17.202085 12363 raft_consensus.cc:2781] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:17.202278 12363 raft_consensus.cc:482] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:17.202378 12363 raft_consensus.cc:3037] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.205411 12363 raft_consensus.cc:504] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.206131 12363 leader_election.cc:288] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 election: Requested vote from peers 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319), be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711)
I20260619 04:39:17.206651 12291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2afb3d4ebc545d698bf4f74dea831a9" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346119ed9cd74093ad3d2859d6855143"
I20260619 04:39:17.206665 12010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2afb3d4ebc545d698bf4f74dea831a9" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b"
I20260619 04:39:17.206879 12291 raft_consensus.cc:3037] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.206898 12010 raft_consensus.cc:3037] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.209064 12291 raft_consensus.cc:2454] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 1.
I20260619 04:39:17.209532 12081 leader_election.cc:302] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:17.209815 12363 raft_consensus.cc:2781] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:17.210000 12010 raft_consensus.cc:2454] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 1.
I20260619 04:39:17.210426 12363 raft_consensus.cc:686] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 LEADER]: Becoming Leader. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Running, Role: LEADER
I20260619 04:39:17.211024 12363 consensus_queue.cc:237] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } }
I20260619 04:39:17.215773 11850 catalog_manager.cc:5495] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "d9977fb8e38c47d08d3494f17fd7b976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } health_report { overall_health: HEALTHY } } }
Jun 19 04:39:17 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843955, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:17.314479 12373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.301011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44131 (local address 127.0.0.1:50936)
0619 04:39:17.301618 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.301652 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.301818 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.302149 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.302153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.302867 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:17.303153 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.303162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.304205 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.304212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.305187 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.305198 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.305940 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.305946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.306104 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.306907 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:17.306929 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:17.309149 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:17.312223 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:17.312234 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:17.312240 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:17.312648 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:17.312967 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:17.312970 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:17.312973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:17.313110 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:17.313605 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:17.313611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:17.313757 (+ 146us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.313884 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.314080 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":315,"threads_started":1}
I20260619 04:39:17.314558 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.301026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.9.224.126:44131)
0619 04:39:17.301202 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.301224 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.301740 (+ 516us) server_negotiation.cc:407] Connection header received
0619 04:39:17.301952 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.301957 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.302018 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.302116 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:17.303301 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.304081 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.305334 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.305753 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.305883 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.309342 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:17.309347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:17.309350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:17.309390 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:17.312023 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:17.312754 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:17.312758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:17.312760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:17.312875 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:17.313226 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:17.313229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:17.313231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:17.313501 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:17.313605 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.313976 (+ 371us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.314311 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":64}
I20260619 04:39:17.319697 11850 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:50936:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 04:39:17.320768 11850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:17.326953 12127 tablet_service.cc:1467] Processing CreateTablet for tablet bc99f125be984ae4aae86a1f52e3c69f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=44fd1a22a70a405a81fd412187aead3e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:39:17.326953 11988 tablet_service.cc:1467] Processing CreateTablet for tablet bc99f125be984ae4aae86a1f52e3c69f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=44fd1a22a70a405a81fd412187aead3e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:39:17.327966 11988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc99f125be984ae4aae86a1f52e3c69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.327963 12127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc99f125be984ae4aae86a1f52e3c69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.327564 12266 tablet_service.cc:1467] Processing CreateTablet for tablet bc99f125be984ae4aae86a1f52e3c69f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=44fd1a22a70a405a81fd412187aead3e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:39:17.328310 12266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc99f125be984ae4aae86a1f52e3c69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.333694 12356 tablet_bootstrap.cc:492] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: Bootstrap starting.
I20260619 04:39:17.335170 12358 tablet_bootstrap.cc:492] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: Bootstrap starting.
I20260619 04:39:17.335201 12356 tablet_bootstrap.cc:654] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.335801 12355 tablet_bootstrap.cc:492] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: Bootstrap starting.
I20260619 04:39:17.336930 12358 tablet_bootstrap.cc:654] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.337420 12355 tablet_bootstrap.cc:654] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.337695 12356 tablet_bootstrap.cc:492] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: No bootstrap required, opened a new log
I20260619 04:39:17.337875 12356 ts_tablet_manager.cc:1397] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260619 04:39:17.338879 12356 raft_consensus.cc:348] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.339103 12356 raft_consensus.cc:374] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.339190 12356 raft_consensus.cc:729] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.339452 12356 consensus_queue.cc:260] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.340087 12355 tablet_bootstrap.cc:492] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: No bootstrap required, opened a new log
I20260619 04:39:17.340132 12356 ts_tablet_manager.cc:1428] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 04:39:17.339979 12362 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.340245 12355 ts_tablet_manager.cc:1397] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260619 04:39:17.340354 12362 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.340883 12355 raft_consensus.cc:348] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.341110 12355 raft_consensus.cc:374] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.341208 12355 raft_consensus.cc:729] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be851e35e66f407a9817fd0b74f15a2b, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.341447 12355 consensus_queue.cc:260] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.341751 12358 tablet_bootstrap.cc:492] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: No bootstrap required, opened a new log
I20260619 04:39:17.341971 12358 ts_tablet_manager.cc:1397] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260619 04:39:17.342027 12355 ts_tablet_manager.cc:1428] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 04:39:17.342450 12361 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.342857 12361 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.342810 12358 raft_consensus.cc:348] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.343065 12358 raft_consensus.cc:374] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.343181 12358 raft_consensus.cc:729] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.343421 12358 consensus_queue.cc:260] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.343927 12363 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.344219 12363 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.344655 12358 ts_tablet_manager.cc:1428] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:17.405298 12362 raft_consensus.cc:482] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:17.405547 12362 raft_consensus.cc:504] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.407321 12362 leader_election.cc:288] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807)
I20260619 04:39:17.413883 12352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.407651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:59287 (local address 127.9.224.65:33711)
0619 04:39:17.407909 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.407919 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.408473 (+ 554us) server_negotiation.cc:407] Connection header received
0619 04:39:17.408716 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.408724 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.408801 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.408878 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:17.409486 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.410330 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.412081 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.412881 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.413011 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.413123 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.413452 (+ 329us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.413584 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:17.413873 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.407813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:45623 (local address 127.9.224.66:39807)
0619 04:39:17.408060 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.408069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.408611 (+ 542us) server_negotiation.cc:407] Connection header received
0619 04:39:17.408778 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.408782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.408865 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.408958 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:17.409586 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.410410 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.412152 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.412930 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.413111 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.413190 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.413496 (+ 306us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.413612 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260619 04:39:17.413981 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.407547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:33711 (local address 127.9.224.67:59287)
0619 04:39:17.408353 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.408373 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.408528 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.408914 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.408921 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.408949 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:17.409316 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.409326 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.410462 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.410470 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.411921 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.411933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.413051 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.413057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.413297 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.413322 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.413395 (+ 73us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.413541 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":62,"spinlock_wait_cycles":25472,"thread_start_us":536,"threads_started":1}
I20260619 04:39:17.414287 12378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.407745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:39807 (local address 127.9.224.67:45623)
0619 04:39:17.408502 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.408516 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.408648 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.409000 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.409005 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.409042 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:17.409394 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.409425 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.410549 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.410553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.411968 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.411980 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.413182 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.413188 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.413320 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.413341 (+ 21us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.413457 (+ 116us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.413580 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"mutex_wait_us":27,"thread_start_us":500,"threads_started":1}
I20260619 04:39:17.414633 12010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc99f125be984ae4aae86a1f52e3c69f" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b" is_pre_election: true
I20260619 04:39:17.414911 12010 raft_consensus.cc:2454] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 0.
I20260619 04:39:17.415311 12147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc99f125be984ae4aae86a1f52e3c69f" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9977fb8e38c47d08d3494f17fd7b976" is_pre_election: true
I20260619 04:39:17.415452 12218 leader_election.cc:302] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, be851e35e66f407a9817fd0b74f15a2b; no voters:
I20260619 04:39:17.415716 12147 raft_consensus.cc:2454] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 0.
I20260619 04:39:17.415879 12362 raft_consensus.cc:2781] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:17.415992 12362 raft_consensus.cc:482] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:17.416090 12362 raft_consensus.cc:3037] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.418401 12362 raft_consensus.cc:504] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.418939 12362 leader_election.cc:288] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 election: Requested vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807)
I20260619 04:39:17.419399 12010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc99f125be984ae4aae86a1f52e3c69f" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b"
I20260619 04:39:17.419423 12147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc99f125be984ae4aae86a1f52e3c69f" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9977fb8e38c47d08d3494f17fd7b976"
I20260619 04:39:17.419612 12147 raft_consensus.cc:3037] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.419625 12010 raft_consensus.cc:3037] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.421559 12010 raft_consensus.cc:2454] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 1.
I20260619 04:39:17.421729 12147 raft_consensus.cc:2454] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 1.
I20260619 04:39:17.421973 12218 leader_election.cc:302] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, be851e35e66f407a9817fd0b74f15a2b; no voters:
I20260619 04:39:17.422273 12362 raft_consensus.cc:2781] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:17.422701 12362 raft_consensus.cc:686] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [term 1 LEADER]: Becoming Leader. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Running, Role: LEADER
I20260619 04:39:17.423242 12362 consensus_queue.cc:237] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.426146 12379 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: TxnStatusTablet state changed. Reason: New leader 346119ed9cd74093ad3d2859d6855143. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.426529 12379 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:39:17.427277 12381 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 04:39:17.427559 12381 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 04:39:17.428099 11851 catalog_manager.cc:5495] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346119ed9cd74093ad3d2859d6855143 (127.9.224.67). New cstate: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260619 04:39:17.449842 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.443339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.9.224.67:34319)
0619 04:39:17.443526 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.443534 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.443814 (+ 280us) server_negotiation.cc:407] Connection header received
0619 04:39:17.444136 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.444140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.444247 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.444425 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:17.444819 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.445740 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.447284 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.447802 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.447966 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.448493 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.449040 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.449246 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.449356 (+ 110us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.449452 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:39:17.449842 12373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.443352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34319 (local address 127.0.0.1:60720)
0619 04:39:17.443696 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.443713 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.443914 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.444439 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.444444 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.444457 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:17.444677 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.444687 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.445882 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.445890 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.447125 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.447140 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.447987 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.447994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.448219 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.448280 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.449219 (+ 939us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.449243 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.449336 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.449497 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260619 04:39:17.458582 12147 raft_consensus.cc:1261] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Refusing update from remote peer 346119ed9cd74093ad3d2859d6855143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:17.458593 12010 raft_consensus.cc:1261] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Refusing update from remote peer 346119ed9cd74093ad3d2859d6855143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:17.459600 12379 consensus_queue.cc:1035] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:17.459952 12362 consensus_queue.cc:1035] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:17.467463 12363 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: TxnStatusTablet state changed. Reason: New leader 346119ed9cd74093ad3d2859d6855143. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.467813 12363 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.474025 12379 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.474419 12379 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:39:17.477609 12363 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.477926 12363 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P d9977fb8e38c47d08d3494f17fd7b976: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.482165 12362 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.482134 12361 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: TxnStatusTablet state changed. Reason: New leader 346119ed9cd74093ad3d2859d6855143. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.482515 12362 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P 346119ed9cd74093ad3d2859d6855143: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:39:17.482519 12361 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.483904 12361 tablet_replica.cc:439] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } } }
I20260619 04:39:17.484151 12361 tablet_replica.cc:442] T bc99f125be984ae4aae86a1f52e3c69f P be851e35e66f407a9817fd0b74f15a2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:39:17.496115 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.489403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54256 (local address 127.9.224.66:39807)
0619 04:39:17.489565 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.489570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.490067 (+ 497us) server_negotiation.cc:407] Connection header received
0619 04:39:17.490223 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.490253 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.490383 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.490536 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:17.490944 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.492078 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.493545 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.494147 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.494304 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.494723 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.495481 (+ 758us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.495627 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.495722 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.495809 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:39:17.514029 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.507465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:44407 (local address 127.9.224.67:34319)
0619 04:39:17.507772 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.507783 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.508322 (+ 539us) server_negotiation.cc:407] Connection header received
0619 04:39:17.508546 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.508552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.508667 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.508783 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:17.509322 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.510072 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.512138 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.512649 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.512760 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.513332 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.513441 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.513511 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.513711 (+ 200us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.513784 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 04:39:17.514199 12396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.507454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34319 (local address 127.9.224.66:44407)
0619 04:39:17.508194 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.508214 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.508371 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.508821 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.508826 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.508841 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:17.509176 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.509187 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.510203 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.510210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.511963 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.511979 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.512836 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.512843 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.513022 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.513103 (+ 81us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.513540 (+ 437us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.513554 (+ 14us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.513642 (+ 88us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.513795 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":396,"threads_started":1}
I20260619 04:39:17.524152 12010 raft_consensus.cc:1261] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Refusing update from remote peer d9977fb8e38c47d08d3494f17fd7b976: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:17.524470 12291 raft_consensus.cc:1261] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Refusing update from remote peer d9977fb8e38c47d08d3494f17fd7b976: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:17.524787 12366 consensus_queue.cc:1035] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:17.525166 12363 consensus_queue.cc:1035] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:17.535735 12386 mvcc.cc:205] Tried to move back new op lower bound from 7298432850013151232 to 7298432848740495360. Current Snapshot: MvccSnapshot[applied={T|T < 7298432850013151232}]
I20260619 04:39:17.571925 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.564605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:56547 (local address 127.9.224.66:39807)
0619 04:39:17.564849 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.564859 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.565464 (+ 605us) server_negotiation.cc:407] Connection header received
0619 04:39:17.565761 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.565773 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.565855 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.565959 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:17.566891 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.567714 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.569857 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.570533 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.570680 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.571223 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.571331 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.571425 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.571539 (+ 114us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.571612 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:39:17.572157 12401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.564544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:39807 (local address 127.9.224.67:56547)
0619 04:39:17.565366 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.565389 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.565541 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.565990 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.565995 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.566010 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:17.566548 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.566562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.567864 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.567871 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.569718 (+ 1847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.569735 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.570772 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.570782 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.570954 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.571036 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.571429 (+ 393us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.571443 (+ 14us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.571522 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.571654 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":374,"threads_started":1}
I20260619 04:39:17.617465 11851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:17.617808 11851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:17.622306 11851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Sending DeleteTablet for 3 replicas of tablet b2afb3d4ebc545d698bf4f74dea831a9
I20260619 04:39:17.623749 11988 tablet_service.cc:1514] Processing DeleteTablet for tablet b2afb3d4ebc545d698bf4f74dea831a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:17 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:55820
I20260619 04:39:17.625253 12127 tablet_service.cc:1514] Processing DeleteTablet for tablet b2afb3d4ebc545d698bf4f74dea831a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:17 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:54240
I20260619 04:39:17.626310 12266 tablet_service.cc:1514] Processing DeleteTablet for tablet b2afb3d4ebc545d698bf4f74dea831a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:17 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60706
I20260619 04:39:17.630873 12406 tablet_replica.cc:330] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: stopping tablet replica
I20260619 04:39:17.630775 11851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 04:39:17.631520 12406 raft_consensus.cc:2229] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 04:39:17.631927 11851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:17.631973 12406 raft_consensus.cc:2258] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:17.639906 12406 ts_tablet_manager.cc:1905] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:17.642501 11987 tablet_service.cc:1467] Processing CreateTablet for tablet 56b85427771448158c49df878e7724d4 (DEFAULT_TABLE table=test-table [id=e46d217667a04e68ac78ec055a97e0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:17.643107 11987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b85427771448158c49df878e7724d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.643033 12266 tablet_service.cc:1467] Processing CreateTablet for tablet 56b85427771448158c49df878e7724d4 (DEFAULT_TABLE table=test-table [id=e46d217667a04e68ac78ec055a97e0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:17.643535 12266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b85427771448158c49df878e7724d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.646731 12126 tablet_service.cc:1467] Processing CreateTablet for tablet 56b85427771448158c49df878e7724d4 (DEFAULT_TABLE table=test-table [id=e46d217667a04e68ac78ec055a97e0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:17.647322 12126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56b85427771448158c49df878e7724d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:17.651317 12356 tablet_bootstrap.cc:492] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Bootstrap starting.
I20260619 04:39:17.652184 12404 tablet_replica.cc:330] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: stopping tablet replica
I20260619 04:39:17.652688 12404 raft_consensus.cc:2229] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:17.653079 12356 tablet_bootstrap.cc:654] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.653122 12404 raft_consensus.cc:2258] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:17.655946 12406 ts_tablet_manager.cc:1918] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:17.656167 12406 log.cc:1196] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b2afb3d4ebc545d698bf4f74dea831a9
I20260619 04:39:17.657065 12406 ts_tablet_manager.cc:1939] T b2afb3d4ebc545d698bf4f74dea831a9 P 346119ed9cd74093ad3d2859d6855143: Deleting consensus metadata
I20260619 04:39:17.660001 11838 catalog_manager.cc:4841] TS 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319): tablet b2afb3d4ebc545d698bf4f74dea831a9 (table test-table [id=56ce64d4a9c24128b7218d1f8dfdc229]) successfully deleted
I20260619 04:39:17.660480 12355 tablet_bootstrap.cc:492] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Bootstrap starting.
I20260619 04:39:17.662531 12358 tablet_bootstrap.cc:492] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Bootstrap starting.
I20260619 04:39:17.663627 12405 tablet_replica.cc:330] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: stopping tablet replica
I20260619 04:39:17.663873 12355 tablet_bootstrap.cc:654] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.666648 12356 tablet_bootstrap.cc:492] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: No bootstrap required, opened a new log
I20260619 04:39:17.666893 12356 ts_tablet_manager.cc:1397] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.002s
I20260619 04:39:17.667482 12404 ts_tablet_manager.cc:1905] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:17.668432 12356 raft_consensus.cc:348] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.668802 12356 raft_consensus.cc:374] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.669497 12356 raft_consensus.cc:729] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.669886 12356 consensus_queue.cc:260] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.673365 12356 ts_tablet_manager.cc:1428] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 04:39:17.674397 12358 tablet_bootstrap.cc:654] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:17.664145 12405 raft_consensus.cc:2229] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:17.679632 12405 raft_consensus.cc:2258] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:17.685696 12355 tablet_bootstrap.cc:492] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: No bootstrap required, opened a new log
I20260619 04:39:17.685886 12355 ts_tablet_manager.cc:1397] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.016s
I20260619 04:39:17.686872 12355 raft_consensus.cc:348] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.687168 12355 raft_consensus.cc:374] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.687256 12355 raft_consensus.cc:729] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be851e35e66f407a9817fd0b74f15a2b, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.687579 12355 consensus_queue.cc:260] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.689036 12355 ts_tablet_manager.cc:1428] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:17.694844 12405 ts_tablet_manager.cc:1905] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:17.700546 12358 tablet_bootstrap.cc:492] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: No bootstrap required, opened a new log
I20260619 04:39:17.700791 12358 ts_tablet_manager.cc:1397] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.000s
I20260619 04:39:17.701762 12358 raft_consensus.cc:348] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.702091 12358 raft_consensus.cc:374] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:17.702216 12358 raft_consensus.cc:729] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Initialized, Role: FOLLOWER
I20260619 04:39:17.702579 12358 consensus_queue.cc:260] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.704316 12358 ts_tablet_manager.cc:1428] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 04:39:17.714057 12404 ts_tablet_manager.cc:1918] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:17.714414 12404 log.cc:1196] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/b2afb3d4ebc545d698bf4f74dea831a9
I20260619 04:39:17.715293 12379 raft_consensus.cc:482] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:17.715492 12379 raft_consensus.cc:504] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.716233 12379 leader_election.cc:288] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807)
I20260619 04:39:17.717190 12147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b85427771448158c49df878e7724d4" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9977fb8e38c47d08d3494f17fd7b976" is_pre_election: true
I20260619 04:39:17.717476 12147 raft_consensus.cc:2454] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 0.
I20260619 04:39:17.717821 12009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b85427771448158c49df878e7724d4" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b" is_pre_election: true
I20260619 04:39:17.718152 12009 raft_consensus.cc:2454] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 0.
I20260619 04:39:17.715062 12404 ts_tablet_manager.cc:1939] T b2afb3d4ebc545d698bf4f74dea831a9 P be851e35e66f407a9817fd0b74f15a2b: Deleting consensus metadata
I20260619 04:39:17.718784 12220 leader_election.cc:302] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:17.719177 12379 raft_consensus.cc:2781] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:17.719274 12379 raft_consensus.cc:482] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:17.719386 12379 raft_consensus.cc:3037] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.720952 11836 catalog_manager.cc:4841] TS be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711): tablet b2afb3d4ebc545d698bf4f74dea831a9 (table test-table [id=56ce64d4a9c24128b7218d1f8dfdc229]) successfully deleted
I20260619 04:39:17.722438 12405 ts_tablet_manager.cc:1918] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:17.722697 12405 log.cc:1196] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b2afb3d4ebc545d698bf4f74dea831a9
I20260619 04:39:17.723279 12405 ts_tablet_manager.cc:1939] T b2afb3d4ebc545d698bf4f74dea831a9 P d9977fb8e38c47d08d3494f17fd7b976: Deleting consensus metadata
I20260619 04:39:17.723914 12379 raft_consensus.cc:504] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.725076 12009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b85427771448158c49df878e7724d4" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b"
I20260619 04:39:17.725284 12009 raft_consensus.cc:3037] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.728400 12009 raft_consensus.cc:2454] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 1.
I20260619 04:39:17.728986 12218 leader_election.cc:302] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, be851e35e66f407a9817fd0b74f15a2b; no voters:
I20260619 04:39:17.729292 12362 raft_consensus.cc:2781] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:17.730268 11838 catalog_manager.cc:4841] TS d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807): tablet b2afb3d4ebc545d698bf4f74dea831a9 (table test-table [id=56ce64d4a9c24128b7218d1f8dfdc229]) successfully deleted
I20260619 04:39:17.732771 12147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56b85427771448158c49df878e7724d4" candidate_uuid: "346119ed9cd74093ad3d2859d6855143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9977fb8e38c47d08d3494f17fd7b976"
I20260619 04:39:17.733006 12147 raft_consensus.cc:3037] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:17.736382 12147 raft_consensus.cc:2454] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346119ed9cd74093ad3d2859d6855143 in term 1.
I20260619 04:39:17.737004 12379 leader_election.cc:288] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [CANDIDATE]: Term 1 election: Requested vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807)
I20260619 04:39:17.737897 12362 raft_consensus.cc:686] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 1 LEADER]: Becoming Leader. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Running, Role: LEADER
I20260619 04:39:17.738268 12362 consensus_queue.cc:237] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:17.741158 11850 catalog_manager.cc:5495] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346119ed9cd74093ad3d2859d6855143 (127.9.224.67). New cstate: current_term: 1 leader_uuid: "346119ed9cd74093ad3d2859d6855143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260619 04:39:17.777227 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.770518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60736 (local address 127.9.224.67:34319)
0619 04:39:17.770687 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.770693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.770722 (+ 29us) server_negotiation.cc:407] Connection header received
0619 04:39:17.770784 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.770789 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.770871 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.770969 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:17.771408 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.772645 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.774688 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.775441 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.775600 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.776078 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.776261 (+ 183us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.776354 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.776527 (+ 173us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.776615 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 04:39:17.794597 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.788141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:44275 (local address 127.9.224.67:34319)
0619 04:39:17.788379 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:17.788385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:17.788401 (+ 16us) server_negotiation.cc:407] Connection header received
0619 04:39:17.788588 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:17.788591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:17.788644 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:17.788709 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:17.789144 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.790393 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.792438 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.793149 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.793300 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.793748 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.793892 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.793987 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:17.794158 (+ 171us) server_negotiation.cc:299] Negotiation successful
0619 04:39:17.794269 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260619 04:39:17.794907 12401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:17.788088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34319 (local address 127.9.224.67:44275)
0619 04:39:17.788290 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:17.788311 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:17.788434 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:17.788766 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:17.788774 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:17.788788 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:39:17.789013 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.789025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.790551 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.790557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.792267 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:17.792283 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:17.793318 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:17.793323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:17.793503 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:17.793557 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:39:17.794010 (+ 453us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:39:17.794023 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 04:39:17.794118 (+ 95us) client_negotiation.cc:240] Negotiation successful
0619 04:39:17.794320 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260619 04:39:17.804157 12010 raft_consensus.cc:1261] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Refusing update from remote peer 346119ed9cd74093ad3d2859d6855143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:17.804242 12147 raft_consensus.cc:1261] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Refusing update from remote peer 346119ed9cd74093ad3d2859d6855143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:17.804821 12410 consensus_queue.cc:1035] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:17.805394 12379 consensus_queue.cc:1035] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:17.819886 12384 mvcc.cc:205] Tried to move back new op lower bound from 7298432851160145920 to 7298432850898960384. Current Snapshot: MvccSnapshot[applied={T|T < 7298432851160145920}]
W20260619 04:39:17.845949 12384 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260619 04:39:19.454341 11850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:19.454597 11850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:19.458957 11850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Sending DeleteTablet for 3 replicas of tablet 56b85427771448158c49df878e7724d4
I20260619 04:39:19.460026 11987 tablet_service.cc:1514] Processing DeleteTablet for tablet 56b85427771448158c49df878e7724d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:19 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:55820
I20260619 04:39:19.460023 12127 tablet_service.cc:1514] Processing DeleteTablet for tablet 56b85427771448158c49df878e7724d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:19 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:54240
I20260619 04:39:19.460573 12266 tablet_service.cc:1514] Processing DeleteTablet for tablet 56b85427771448158c49df878e7724d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:19 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60706
I20260619 04:39:19.467022 12436 tablet_replica.cc:330] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: stopping tablet replica
I20260619 04:39:19.467309 12436 raft_consensus.cc:2229] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:19.468030 12436 raft_consensus.cc:2258] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:19.469229 12436 ts_tablet_manager.cc:1905] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:19.476341 12435 tablet_replica.cc:330] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: stopping tablet replica
I20260619 04:39:19.476954 12435 raft_consensus.cc:2229] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:19.477381 12435 raft_consensus.cc:2258] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:19.478019 12436 ts_tablet_manager.cc:1918] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 04:39:19.478061 12434 tablet_replica.cc:330] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: stopping tablet replica
I20260619 04:39:19.478188 12436 log.cc:1196] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/56b85427771448158c49df878e7724d4
I20260619 04:39:19.478318 12434 raft_consensus.cc:2229] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:19.478636 12434 raft_consensus.cc:2258] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:19.478899 12436 ts_tablet_manager.cc:1939] T 56b85427771448158c49df878e7724d4 P 346119ed9cd74093ad3d2859d6855143: Deleting consensus metadata
I20260619 04:39:19.479020 12435 ts_tablet_manager.cc:1905] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:19.479686 12434 ts_tablet_manager.cc:1905] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:19.480424 11838 catalog_manager.cc:4841] TS 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319): tablet 56b85427771448158c49df878e7724d4 (table test-table [id=e46d217667a04e68ac78ec055a97e0c5]) successfully deleted
I20260619 04:39:19.486068 12435 ts_tablet_manager.cc:1918] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 04:39:19.486261 12435 log.cc:1196] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/56b85427771448158c49df878e7724d4
I20260619 04:39:19.486673 12435 ts_tablet_manager.cc:1939] T 56b85427771448158c49df878e7724d4 P d9977fb8e38c47d08d3494f17fd7b976: Deleting consensus metadata
I20260619 04:39:19.487069 12434 ts_tablet_manager.cc:1918] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 04:39:19.487213 12434 log.cc:1196] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/56b85427771448158c49df878e7724d4
I20260619 04:39:19.487663 12434 ts_tablet_manager.cc:1939] T 56b85427771448158c49df878e7724d4 P be851e35e66f407a9817fd0b74f15a2b: Deleting consensus metadata
I20260619 04:39:19.488062 11838 catalog_manager.cc:4841] TS d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807): tablet 56b85427771448158c49df878e7724d4 (table test-table [id=e46d217667a04e68ac78ec055a97e0c5]) successfully deleted
I20260619 04:39:19.488783 11836 catalog_manager.cc:4841] TS be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711): tablet 56b85427771448158c49df878e7724d4 (table test-table [id=e46d217667a04e68ac78ec055a97e0c5]) successfully deleted
Jun 19 04:39:19 dist-test-slave-9dgf krb5kdc[11806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843959, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 04:39:19 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843959, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:19.525595 12444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:19.504799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.9.224.126:44131)
0619 04:39:19.505404 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:19.505409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:19.505485 (+ 76us) server_negotiation.cc:407] Connection header received
0619 04:39:19.505649 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:19.505653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:19.505720 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:19.505824 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:19.507715 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:19.509042 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:19.511249 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:19.512033 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:19.512202 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:19.519689 (+ 7487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:19.519695 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:19.519699 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:19.519766 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:19.522816 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:19.523638 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:19.523644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:19.523646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:19.523807 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:19.524243 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:19.524246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:19.524249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:19.524531 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:19.524707 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:19.524985 (+ 278us) server_negotiation.cc:299] Negotiation successful
0619 04:39:19.525209 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":352,"threads_started":1}
I20260619 04:39:19.529626 11850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:19.530388 11850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:19.537787 11987 tablet_service.cc:1467] Processing CreateTablet for tablet 0dea525ad71a4797bf720a16fcf6db92 (DEFAULT_TABLE table=test-table [id=62f45d8488414fe8895d57227c71b02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:19.537848 12127 tablet_service.cc:1467] Processing CreateTablet for tablet 0dea525ad71a4797bf720a16fcf6db92 (DEFAULT_TABLE table=test-table [id=62f45d8488414fe8895d57227c71b02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:19.538138 12266 tablet_service.cc:1467] Processing CreateTablet for tablet 0dea525ad71a4797bf720a16fcf6db92 (DEFAULT_TABLE table=test-table [id=62f45d8488414fe8895d57227c71b02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:19.538367 11987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dea525ad71a4797bf720a16fcf6db92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:19.538386 12127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dea525ad71a4797bf720a16fcf6db92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:19.538640 12266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dea525ad71a4797bf720a16fcf6db92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:19.545790 12447 tablet_bootstrap.cc:492] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Bootstrap starting.
I20260619 04:39:19.546912 12445 tablet_bootstrap.cc:492] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Bootstrap starting.
I20260619 04:39:19.547771 12446 tablet_bootstrap.cc:492] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Bootstrap starting.
I20260619 04:39:19.548827 12447 tablet_bootstrap.cc:654] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:19.548902 12445 tablet_bootstrap.cc:654] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:19.549510 12446 tablet_bootstrap.cc:654] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:19.551355 12445 tablet_bootstrap.cc:492] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: No bootstrap required, opened a new log
I20260619 04:39:19.551576 12445 ts_tablet_manager.cc:1397] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260619 04:39:19.551685 12447 tablet_bootstrap.cc:492] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: No bootstrap required, opened a new log
I20260619 04:39:19.551828 12447 ts_tablet_manager.cc:1397] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260619 04:39:19.551851 12446 tablet_bootstrap.cc:492] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: No bootstrap required, opened a new log
I20260619 04:39:19.551991 12446 ts_tablet_manager.cc:1397] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260619 04:39:19.552696 12445 raft_consensus.cc:348] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.552680 12447 raft_consensus.cc:348] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.552772 12446 raft_consensus.cc:348] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.552948 12447 raft_consensus.cc:374] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:19.552939 12445 raft_consensus.cc:374] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:19.553009 12446 raft_consensus.cc:374] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:19.553035 12447 raft_consensus.cc:729] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Initialized, Role: FOLLOWER
I20260619 04:39:19.553045 12445 raft_consensus.cc:729] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be851e35e66f407a9817fd0b74f15a2b, State: Initialized, Role: FOLLOWER
I20260619 04:39:19.553102 12446 raft_consensus.cc:729] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Initialized, Role: FOLLOWER
I20260619 04:39:19.553277 12447 consensus_queue.cc:260] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.553320 12445 consensus_queue.cc:260] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.553411 12446 consensus_queue.cc:260] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.553937 12446 ts_tablet_manager.cc:1428] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 04:39:19.554768 12447 ts_tablet_manager.cc:1428] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 04:39:19.556018 12445 ts_tablet_manager.cc:1428] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260619 04:39:19.804919 12451 raft_consensus.cc:482] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:19.805203 12451 raft_consensus.cc:504] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.805943 12451 leader_election.cc:288] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319)
I20260619 04:39:19.806726 12008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dea525ad71a4797bf720a16fcf6db92" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b" is_pre_election: true
I20260619 04:39:19.806726 12291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dea525ad71a4797bf720a16fcf6db92" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346119ed9cd74093ad3d2859d6855143" is_pre_election: true
I20260619 04:39:19.806995 12291 raft_consensus.cc:2454] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 0.
I20260619 04:39:19.807045 12008 raft_consensus.cc:2454] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 0.
I20260619 04:39:19.807586 12079 leader_election.cc:302] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, be851e35e66f407a9817fd0b74f15a2b, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:19.807971 12451 raft_consensus.cc:2781] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:19.808126 12451 raft_consensus.cc:482] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:19.808240 12451 raft_consensus.cc:3037] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:19.810384 12451 raft_consensus.cc:504] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.810961 12451 leader_election.cc:288] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 election: Requested vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319)
I20260619 04:39:19.811632 12008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dea525ad71a4797bf720a16fcf6db92" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b"
I20260619 04:39:19.811632 12291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dea525ad71a4797bf720a16fcf6db92" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346119ed9cd74093ad3d2859d6855143"
I20260619 04:39:19.811862 12008 raft_consensus.cc:3037] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:19.811862 12291 raft_consensus.cc:3037] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:19.814982 12008 raft_consensus.cc:2454] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 1.
I20260619 04:39:19.814991 12291 raft_consensus.cc:2454] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 1.
I20260619 04:39:19.815574 12081 leader_election.cc:302] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, be851e35e66f407a9817fd0b74f15a2b, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:19.815928 12451 raft_consensus.cc:2781] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:19.816375 12451 raft_consensus.cc:686] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 LEADER]: Becoming Leader. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Running, Role: LEADER
I20260619 04:39:19.816676 12451 consensus_queue.cc:237] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.819612 11850 catalog_manager.cc:5495] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "d9977fb8e38c47d08d3494f17fd7b976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } health_report { overall_health: UNKNOWN } } }
I20260619 04:39:19.859480 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:19.853481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54270 (local address 127.9.224.66:39807)
0619 04:39:19.854645 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:19.854649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:19.854668 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:39:19.854721 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:19.854725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:19.854787 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:19.854930 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:19.855349 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:19.856199 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:19.857630 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:19.858052 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:19.858212 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:19.858668 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:19.858783 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:19.858885 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:19.859041 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 04:39:19.859120 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1061,"thread_start_us":906,"threads_started":1}
I20260619 04:39:19.869355 12291 raft_consensus.cc:1261] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Refusing update from remote peer d9977fb8e38c47d08d3494f17fd7b976: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:19.869952 12008 raft_consensus.cc:1261] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Refusing update from remote peer d9977fb8e38c47d08d3494f17fd7b976: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:19.870031 12453 consensus_queue.cc:1035] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:19.870699 12451 consensus_queue.cc:1035] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:19.920295 11851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:19.920529 11851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:19.923583 11851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Sending DeleteTablet for 3 replicas of tablet 0dea525ad71a4797bf720a16fcf6db92
I20260619 04:39:19.924577 12127 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dea525ad71a4797bf720a16fcf6db92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:19 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:54240
I20260619 04:39:19.924615 11987 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dea525ad71a4797bf720a16fcf6db92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:19 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:55820
I20260619 04:39:19.924646 12266 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dea525ad71a4797bf720a16fcf6db92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:19 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60706
I20260619 04:39:19.924907 12434 tablet_replica.cc:330] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: stopping tablet replica
I20260619 04:39:19.924952 12435 tablet_replica.cc:330] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: stopping tablet replica
I20260619 04:39:19.925145 12436 tablet_replica.cc:330] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: stopping tablet replica
I20260619 04:39:19.925132 12434 raft_consensus.cc:2229] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:19.925197 12435 raft_consensus.cc:2229] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:19.925348 12436 raft_consensus.cc:2229] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:19.925357 12434 raft_consensus.cc:2258] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:19.925534 12435 raft_consensus.cc:2258] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:19.925570 12436 raft_consensus.cc:2258] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:19.925748 11851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:19.926582 11851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:19.926832 12434 ts_tablet_manager.cc:1905] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:19.926877 12435 ts_tablet_manager.cc:1905] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:19.927039 12436 ts_tablet_manager.cc:1905] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:19.934113 12436 ts_tablet_manager.cc:1918] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:19.934340 12436 log.cc:1196] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/0dea525ad71a4797bf720a16fcf6db92
I20260619 04:39:19.934652 12127 tablet_service.cc:1467] Processing CreateTablet for tablet 0d532c0bb62647b9b49c2a18ab09a2fe (DEFAULT_TABLE table=test-table [id=398ac0b1274d4cc691a68532c375da4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:19.934640 11987 tablet_service.cc:1467] Processing CreateTablet for tablet 0d532c0bb62647b9b49c2a18ab09a2fe (DEFAULT_TABLE table=test-table [id=398ac0b1274d4cc691a68532c375da4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:19.934842 12436 ts_tablet_manager.cc:1939] T 0dea525ad71a4797bf720a16fcf6db92 P 346119ed9cd74093ad3d2859d6855143: Deleting consensus metadata
I20260619 04:39:19.935156 12127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d532c0bb62647b9b49c2a18ab09a2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:19.935150 11987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d532c0bb62647b9b49c2a18ab09a2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:19.936050 12434 ts_tablet_manager.cc:1918] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:19.936259 12434 log.cc:1196] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/0dea525ad71a4797bf720a16fcf6db92
I20260619 04:39:19.936866 12434 ts_tablet_manager.cc:1939] T 0dea525ad71a4797bf720a16fcf6db92 P be851e35e66f407a9817fd0b74f15a2b: Deleting consensus metadata
I20260619 04:39:19.938098 11836 catalog_manager.cc:4841] TS be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711): tablet 0dea525ad71a4797bf720a16fcf6db92 (table test-table [id=62f45d8488414fe8895d57227c71b02e]) successfully deleted
I20260619 04:39:19.938567 11838 catalog_manager.cc:4841] TS 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319): tablet 0dea525ad71a4797bf720a16fcf6db92 (table test-table [id=62f45d8488414fe8895d57227c71b02e]) successfully deleted
I20260619 04:39:19.939595 12266 tablet_service.cc:1467] Processing CreateTablet for tablet 0d532c0bb62647b9b49c2a18ab09a2fe (DEFAULT_TABLE table=test-table [id=398ac0b1274d4cc691a68532c375da4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:19.940069 12266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d532c0bb62647b9b49c2a18ab09a2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:19.941774 12445 tablet_bootstrap.cc:492] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Bootstrap starting.
I20260619 04:39:19.942700 12435 ts_tablet_manager.cc:1918] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:39:19.942833 12447 tablet_bootstrap.cc:492] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Bootstrap starting.
I20260619 04:39:19.942950 12435 log.cc:1196] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/0dea525ad71a4797bf720a16fcf6db92
I20260619 04:39:19.943492 12435 ts_tablet_manager.cc:1939] T 0dea525ad71a4797bf720a16fcf6db92 P d9977fb8e38c47d08d3494f17fd7b976: Deleting consensus metadata
I20260619 04:39:19.943565 12445 tablet_bootstrap.cc:654] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:19.944854 12447 tablet_bootstrap.cc:654] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:19.944856 11838 catalog_manager.cc:4841] TS d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807): tablet 0dea525ad71a4797bf720a16fcf6db92 (table test-table [id=62f45d8488414fe8895d57227c71b02e]) successfully deleted
I20260619 04:39:19.947350 12447 tablet_bootstrap.cc:492] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: No bootstrap required, opened a new log
I20260619 04:39:19.947535 12447 ts_tablet_manager.cc:1397] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260619 04:39:19.948426 12447 raft_consensus.cc:348] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.949201 12447 raft_consensus.cc:374] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:19.949357 12447 raft_consensus.cc:729] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Initialized, Role: FOLLOWER
I20260619 04:39:19.949672 12447 consensus_queue.cc:260] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.950930 12447 ts_tablet_manager.cc:1428] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 04:39:19.952036 12446 tablet_bootstrap.cc:492] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Bootstrap starting.
I20260619 04:39:19.954015 12445 tablet_bootstrap.cc:492] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: No bootstrap required, opened a new log
I20260619 04:39:19.954113 12446 tablet_bootstrap.cc:654] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:19.954200 12445 ts_tablet_manager.cc:1397] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.010s
I20260619 04:39:19.955058 12445 raft_consensus.cc:348] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.955334 12445 raft_consensus.cc:374] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:19.955413 12445 raft_consensus.cc:729] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be851e35e66f407a9817fd0b74f15a2b, State: Initialized, Role: FOLLOWER
I20260619 04:39:19.955690 12445 consensus_queue.cc:260] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.956188 12445 ts_tablet_manager.cc:1428] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 04:39:19.956440 12446 tablet_bootstrap.cc:492] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: No bootstrap required, opened a new log
I20260619 04:39:19.956636 12446 ts_tablet_manager.cc:1397] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260619 04:39:19.957563 12446 raft_consensus.cc:348] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.957858 12446 raft_consensus.cc:374] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:19.957957 12446 raft_consensus.cc:729] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346119ed9cd74093ad3d2859d6855143, State: Initialized, Role: FOLLOWER
I20260619 04:39:19.958346 12446 consensus_queue.cc:260] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:19.958927 12446 ts_tablet_manager.cc:1428] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 04:39:20.203896 12460 raft_consensus.cc:482] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:20.204118 12460 raft_consensus.cc:504] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:20.204869 12460 leader_election.cc:288] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319)
I20260619 04:39:20.205487 12010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d532c0bb62647b9b49c2a18ab09a2fe" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b" is_pre_election: true
I20260619 04:39:20.205528 12291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d532c0bb62647b9b49c2a18ab09a2fe" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346119ed9cd74093ad3d2859d6855143" is_pre_election: true
I20260619 04:39:20.205751 12010 raft_consensus.cc:2454] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 0.
I20260619 04:39:20.205772 12291 raft_consensus.cc:2454] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 0.
I20260619 04:39:20.206271 12079 leader_election.cc:302] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be851e35e66f407a9817fd0b74f15a2b, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:20.206542 12460 raft_consensus.cc:2781] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:20.206662 12460 raft_consensus.cc:482] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:20.206741 12460 raft_consensus.cc:3037] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:20.209709 12460 raft_consensus.cc:504] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:20.210374 12460 leader_election.cc:288] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 election: Requested vote from peers be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711), 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319)
I20260619 04:39:20.210875 12010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d532c0bb62647b9b49c2a18ab09a2fe" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be851e35e66f407a9817fd0b74f15a2b"
I20260619 04:39:20.210893 12291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d532c0bb62647b9b49c2a18ab09a2fe" candidate_uuid: "d9977fb8e38c47d08d3494f17fd7b976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346119ed9cd74093ad3d2859d6855143"
I20260619 04:39:20.211105 12010 raft_consensus.cc:3037] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:20.211117 12291 raft_consensus.cc:3037] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:20.213165 12291 raft_consensus.cc:2454] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 1.
I20260619 04:39:20.213652 12081 leader_election.cc:302] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346119ed9cd74093ad3d2859d6855143, d9977fb8e38c47d08d3494f17fd7b976; no voters:
I20260619 04:39:20.213939 12460 raft_consensus.cc:2781] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:20.214080 12010 raft_consensus.cc:2454] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9977fb8e38c47d08d3494f17fd7b976 in term 1.
I20260619 04:39:20.214125 12460 raft_consensus.cc:686] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 1 LEADER]: Becoming Leader. State: Replica: d9977fb8e38c47d08d3494f17fd7b976, State: Running, Role: LEADER
I20260619 04:39:20.214427 12460 consensus_queue.cc:237] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } }
I20260619 04:39:20.217257 11851 catalog_manager.cc:5495] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "d9977fb8e38c47d08d3494f17fd7b976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9977fb8e38c47d08d3494f17fd7b976" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 } health_report { overall_health: UNKNOWN } } }
I20260619 04:39:20.260272 12010 raft_consensus.cc:1261] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Refusing update from remote peer d9977fb8e38c47d08d3494f17fd7b976: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:20.260254 12291 raft_consensus.cc:1261] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Refusing update from remote peer d9977fb8e38c47d08d3494f17fd7b976: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:20.260882 12460 consensus_queue.cc:1035] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346119ed9cd74093ad3d2859d6855143" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:20.261157 12461 consensus_queue.cc:1035] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be851e35e66f407a9817fd0b74f15a2b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:20.265278 12418 mvcc.cc:205] Tried to move back new op lower bound from 7298432861221449728 to 7298432861040852992. Current Snapshot: MvccSnapshot[applied={T|T < 7298432861221449728}]
W20260619 04:39:20.280683 12418 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260619 04:39:21.876950 11849 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:21.877173 11849 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:21.881203 11849 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d2be47dac234c6b91d59313a837af47: Sending DeleteTablet for 3 replicas of tablet 0d532c0bb62647b9b49c2a18ab09a2fe
I20260619 04:39:21.882050 12127 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d532c0bb62647b9b49c2a18ab09a2fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:21 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:54240
I20260619 04:39:21.882050 11987 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d532c0bb62647b9b49c2a18ab09a2fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:21 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:55820
I20260619 04:39:21.882146 12266 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d532c0bb62647b9b49c2a18ab09a2fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:21 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60706
I20260619 04:39:21.882823 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11922
I20260619 04:39:21.894636 12490 tablet_replica.cc:330] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: stopping tablet replica
I20260619 04:39:21.894908 12490 raft_consensus.cc:2229] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:21.894945 12489 tablet_replica.cc:330] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: stopping tablet replica
I20260619 04:39:21.895251 12490 raft_consensus.cc:2258] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:21.895329 12489 raft_consensus.cc:2229] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:21.895648 12489 raft_consensus.cc:2258] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:21.896374 12491 tablet_replica.cc:330] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: stopping tablet replica
I20260619 04:39:21.896615 12491 raft_consensus.cc:2229] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:21.896775 12490 ts_tablet_manager.cc:1905] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:21.896850 12489 ts_tablet_manager.cc:1905] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:21.897049 12491 raft_consensus.cc:2258] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:21.898015 12491 ts_tablet_manager.cc:1905] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:21.903739 12489 ts_tablet_manager.cc:1918] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 04:39:21.904091 12490 ts_tablet_manager.cc:1918] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 04:39:21.904284 12490 log.cc:1196] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/0d532c0bb62647b9b49c2a18ab09a2fe
I20260619 04:39:21.904574 12491 ts_tablet_manager.cc:1918] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 04:39:21.904762 12491 log.cc:1196] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/0d532c0bb62647b9b49c2a18ab09a2fe
I20260619 04:39:21.904779 12490 ts_tablet_manager.cc:1939] T 0d532c0bb62647b9b49c2a18ab09a2fe P 346119ed9cd74093ad3d2859d6855143: Deleting consensus metadata
I20260619 04:39:21.905347 12491 ts_tablet_manager.cc:1939] T 0d532c0bb62647b9b49c2a18ab09a2fe P d9977fb8e38c47d08d3494f17fd7b976: Deleting consensus metadata
I20260619 04:39:21.905853 11838 catalog_manager.cc:4841] TS 346119ed9cd74093ad3d2859d6855143 (127.9.224.67:34319): tablet 0d532c0bb62647b9b49c2a18ab09a2fe (table test-table [id=398ac0b1274d4cc691a68532c375da4d]) successfully deleted
I20260619 04:39:21.906455 11838 catalog_manager.cc:4841] TS d9977fb8e38c47d08d3494f17fd7b976 (127.9.224.66:39807): tablet 0d532c0bb62647b9b49c2a18ab09a2fe (table test-table [id=398ac0b1274d4cc691a68532c375da4d]) successfully deleted
I20260619 04:39:21.906533 12489 log.cc:1196] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/0d532c0bb62647b9b49c2a18ab09a2fe
I20260619 04:39:21.906992 12489 ts_tablet_manager.cc:1939] T 0d532c0bb62647b9b49c2a18ab09a2fe P be851e35e66f407a9817fd0b74f15a2b: Deleting consensus metadata
I20260619 04:39:21.907964 11836 catalog_manager.cc:4841] TS be851e35e66f407a9817fd0b74f15a2b (127.9.224.65:33711): tablet 0d532c0bb62647b9b49c2a18ab09a2fe (table test-table [id=398ac0b1274d4cc691a68532c375da4d]) successfully deleted
Jun 19 04:39:21 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843959, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:21.922966 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:21.888479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55836 (local address 127.9.224.65:33711)
0619 04:39:21.904192 (+ 15713us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:21.904198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:21.904228 (+ 30us) server_negotiation.cc:407] Connection header received
0619 04:39:21.904296 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:21.904304 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:21.904404 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:21.906368 (+ 1964us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:21.906542 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:21.907826 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:21.909123 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:21.909744 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:21.909862 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:21.916912 (+ 7050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:21.916933 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:21.916954 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:21.917000 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:21.920145 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:21.920834 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:21.920841 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:21.920843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:21.920967 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:21.921408 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:21.921412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:21.921414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:21.921821 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:21.922057 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:21.922404 (+ 347us) server_negotiation.cc:299] Negotiation successful
0619 04:39:21.922583 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15580,"thread_start_us":17689,"threads_started":1}
W20260619 04:39:21.923705 12053 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55836
W20260619 04:39:21.924530 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11922: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:21.924723 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11922
I20260619 04:39:21.943040 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12062
Jun 19 04:39:21 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843959, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:21.958848 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:21.943831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.9.224.66:39807)
0619 04:39:21.944369 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:21.944373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:21.944388 (+ 15us) server_negotiation.cc:407] Connection header received
0619 04:39:21.944438 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:21.944441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:21.944503 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:21.944623 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:21.945865 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:21.946788 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:21.948077 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:21.948504 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:21.948639 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:21.953105 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:21.953122 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:21.953138 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:21.953177 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:21.956032 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:21.956743 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:21.956751 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:21.956753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:21.956893 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:21.957262 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:21.957268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:21.957271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:21.957662 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:21.958022 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:21.958267 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 04:39:21.958495 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":257,"threads_started":1}
W20260619 04:39:21.959515 12192 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54282
W20260619 04:39:21.960203 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12062: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:21.960369 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 12062
I20260619 04:39:21.982730 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12201
Jun 19 04:39:21 dist-test-slave-9dgf krb5kdc[11806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843959, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:21.998117 12495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:21.983524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60742 (local address 127.9.224.67:34319)
0619 04:39:21.984014 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:21.984019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:21.984034 (+ 15us) server_negotiation.cc:407] Connection header received
0619 04:39:21.984088 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:21.984091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:21.984147 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:21.984239 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:21.985631 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:21.986600 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:21.987801 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:21.988210 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:21.988302 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:21.992724 (+ 4422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:21.992740 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:21.992757 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:21.992792 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:21.995587 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:21.996231 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:21.996239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:21.996241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:21.996363 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:21.996722 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:21.996725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:21.996727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:21.997074 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:21.997280 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:21.997574 (+ 294us) server_negotiation.cc:299] Negotiation successful
0619 04:39:21.997737 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":257,"threads_started":1}
W20260619 04:39:21.998785 12331 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60742
W20260619 04:39:21.999459 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12201: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:21.999640 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 12201
I20260619 04:39:22.024580 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 11819
I20260619 04:39:22.025851 11891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:22.141578 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 11819
2026-06-19T04:39:22Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8643 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:22 dist-test-slave-9dgf krb5kdc[12499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:22 dist-test-slave-9dgf krb5kdc[12499](info): set up 2 sockets
Jun 19 04:39:22 dist-test-slave-9dgf krb5kdc[12499](info): commencing operation
krb5kdc: starting...
W20260619 04:39:23.250427 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:23 dist-test-slave-9dgf krb5kdc[12499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:23.443347 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34327
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:34327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:23.769963 12512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:23.770404 12512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:23.770555 12512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:23.778170 12512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:23.778384 12512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:23.778507 12512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:23.778630 12512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:23.778717 12512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:23.788936 12512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:34327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:23.790338 12512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:23.791684 12512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:23.804258 12517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:23.804215 12518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:23.804188 12520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:23.804580 12512 server_base.cc:1034] running on GCE node
I20260619 04:39:23.805409 12512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:23.806951 12512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:23.808198 12512 hybrid_clock.cc:648] HybridClock initialized: now 1781843963808124 us; error 73 us; skew 500 ppm
I20260619 04:39:23.808566 12512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:23 dist-test-slave-9dgf krb5kdc[12499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843963, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:23.811790 12512 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:23.813277 12512 webserver.cc:460] Webserver started at http://127.9.224.126:38193/ using document root <none> and password file <none>
I20260619 04:39:23.813944 12512 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:23.814052 12512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:23.814375 12512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:23.817359 12512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "3a019207727948a4a0a0aceffa88b270"
format_stamp: "Formatted at 2026-06-19 04:39:23 on dist-test-slave-9dgf"
server_key: "dc2f91870e2fcecf291d5a5df48b6dcc"
server_key_iv: "36613b15cd80edb780508e67d6828d20"
server_key_version: "encryptionkey@0"
I20260619 04:39:23.818079 12512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "3a019207727948a4a0a0aceffa88b270"
format_stamp: "Formatted at 2026-06-19 04:39:23 on dist-test-slave-9dgf"
server_key: "dc2f91870e2fcecf291d5a5df48b6dcc"
server_key_iv: "36613b15cd80edb780508e67d6828d20"
server_key_version: "encryptionkey@0"
I20260619 04:39:23.823565 12512 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:39:23.827193 12527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:23.828833 12512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:23.828974 12512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "3a019207727948a4a0a0aceffa88b270"
format_stamp: "Formatted at 2026-06-19 04:39:23 on dist-test-slave-9dgf"
server_key: "dc2f91870e2fcecf291d5a5df48b6dcc"
server_key_iv: "36613b15cd80edb780508e67d6828d20"
server_key_version: "encryptionkey@0"
I20260619 04:39:23.829149 12512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:23.855283 12512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:23.860203 12512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:23.860471 12512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:23.880321 12512 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:34327
I20260619 04:39:23.880344 12578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:34327 every 8 connection(s)
I20260619 04:39:23.881778 12512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:23.885767 12579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:23.892221 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 12512
I20260619 04:39:23.892478 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:23.893149 10113 external_mini_cluster.cc:1428] Setting key f605bbad2405e4e503377077dea147e6
I20260619 04:39:23.897042 12579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270: Bootstrap starting.
I20260619 04:39:23.900800 12579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:23.902206 12579 log.cc:824] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:23.905226 12579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270: No bootstrap required, opened a new log
Jun 19 04:39:23 dist-test-slave-9dgf krb5kdc[12499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:23.913239 12579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a019207727948a4a0a0aceffa88b270" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34327 } }
I20260619 04:39:23.913641 12579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:23.913779 12579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a019207727948a4a0a0aceffa88b270, State: Initialized, Role: FOLLOWER
I20260619 04:39:23.914454 12579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a019207727948a4a0a0aceffa88b270" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34327 } }
I20260619 04:39:23.914710 12579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:23.914889 12579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:23.915061 12579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:23.916913 12582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:23.895317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45426 (local address 127.9.224.126:34327)
0619 04:39:23.896082 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:23.896098 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:23.896149 (+ 51us) server_negotiation.cc:407] Connection header received
0619 04:39:23.898544 (+ 2395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:23.898573 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:23.899145 (+ 572us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:23.899611 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:23.900916 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:23.903033 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:23.904415 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:23.905082 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:23.905291 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:23.909201 (+ 3910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:23.909214 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:23.909233 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:23.909267 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:23.912646 (+ 3379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:23.913329 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:23.913336 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:23.913343 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:23.913515 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:23.913922 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:23.913929 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:23.913933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:23.914590 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:23.914881 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:23.915368 (+ 487us) server_negotiation.cc:299] Negotiation successful
0619 04:39:23.915812 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":326,"threads_started":1}
I20260619 04:39:23.917657 12579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a019207727948a4a0a0aceffa88b270" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34327 } }
I20260619 04:39:23.918263 12579 leader_election.cc:302] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a019207727948a4a0a0aceffa88b270; no voters:
I20260619 04:39:23.918910 12579 leader_election.cc:288] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:23.919031 12584 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:23.920079 12584 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [term 1 LEADER]: Becoming Leader. State: Replica: 3a019207727948a4a0a0aceffa88b270, State: Running, Role: LEADER
I20260619 04:39:23.920733 12584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a019207727948a4a0a0aceffa88b270" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34327 } }
I20260619 04:39:23.921056 12579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:23.923448 12585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a019207727948a4a0a0aceffa88b270" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a019207727948a4a0a0aceffa88b270" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34327 } } }
I20260619 04:39:23.923753 12585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:23.924227 12586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a019207727948a4a0a0aceffa88b270. Latest consensus state: current_term: 1 leader_uuid: "3a019207727948a4a0a0aceffa88b270" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a019207727948a4a0a0aceffa88b270" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34327 } } }
I20260619 04:39:23.924582 12586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:23.926862 12591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:23.932711 12591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:23.942624 12591 catalog_manager.cc:1347] Generated new cluster ID: 68d7e8f6d14145c8979b379e888e9b5a
I20260619 04:39:23.942756 12591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:23.977881 12591 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:23.979382 12591 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:23.987711 12591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a019207727948a4a0a0aceffa88b270: Generated new TSK 0
I20260619 04:39:23.988633 12591 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:24.045814 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34327
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:24.371642 12605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:24.371918 12605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:24.372073 12605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:24.380100 12605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:24.380254 12605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:24.380445 12605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:24.390525 12605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:24.391860 12605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:24.393210 12605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:24.407058 12611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:24.407138 12610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:24.407116 12613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:24.408180 12605 server_base.cc:1034] running on GCE node
I20260619 04:39:24.408785 12605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:24.409678 12605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:24.410880 12605 hybrid_clock.cc:648] HybridClock initialized: now 1781843964410842 us; error 44 us; skew 500 ppm
I20260619 04:39:24.411159 12605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:24 dist-test-slave-9dgf krb5kdc[12499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843964, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:24.414649 12605 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:24.416154 12605 webserver.cc:460] Webserver started at http://127.9.224.65:44063/ using document root <none> and password file <none>
I20260619 04:39:24.416949 12605 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:24.417078 12605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:24.417404 12605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:24.420471 12605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "53eef61f6a2646deb00e3a87a325276d"
format_stamp: "Formatted at 2026-06-19 04:39:24 on dist-test-slave-9dgf"
server_key: "dbc239768402fb10ca5045eb77815370"
server_key_iv: "427ba27e519bbe45230a700f57ce0a80"
server_key_version: "encryptionkey@0"
I20260619 04:39:24.421293 12605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "53eef61f6a2646deb00e3a87a325276d"
format_stamp: "Formatted at 2026-06-19 04:39:24 on dist-test-slave-9dgf"
server_key: "dbc239768402fb10ca5045eb77815370"
server_key_iv: "427ba27e519bbe45230a700f57ce0a80"
server_key_version: "encryptionkey@0"
I20260619 04:39:24.426584 12605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:39:24.429929 12620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:24.431309 12605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:24.431478 12605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "53eef61f6a2646deb00e3a87a325276d"
format_stamp: "Formatted at 2026-06-19 04:39:24 on dist-test-slave-9dgf"
server_key: "dbc239768402fb10ca5045eb77815370"
server_key_iv: "427ba27e519bbe45230a700f57ce0a80"
server_key_version: "encryptionkey@0"
I20260619 04:39:24.431685 12605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:24.447764 12605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:24.452039 12605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:24.452334 12605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:24.453310 12605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:24.454631 12605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:24.454741 12605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:24.454886 12605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:24.454962 12605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:24.488790 12605 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:38825
I20260619 04:39:24.488879 12732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:38825 every 8 connection(s)
I20260619 04:39:24.490149 12605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:24.494697 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 12605
I20260619 04:39:24.494911 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:24.495522 10113 external_mini_cluster.cc:1428] Setting key f1e8135cae28d13ae07a6fc15dab795a
Jun 19 04:39:24 dist-test-slave-9dgf krb5kdc[12499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843964, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:24.511950 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:24.492876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:47477 (local address 127.9.224.126:34327)
0619 04:39:24.493363 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:24.493368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:24.494192 (+ 824us) server_negotiation.cc:407] Connection header received
0619 04:39:24.496500 (+ 2308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:24.496507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:24.496628 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:24.496761 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:24.498672 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:24.499442 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:24.501110 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:24.501554 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:24.501713 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:24.505501 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:24.505508 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:24.505511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:24.505548 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:24.508397 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:24.509275 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:24.509281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:24.509283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:24.509419 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:24.509921 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:24.509933 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:24.509935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:24.510223 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:24.510470 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:24.511263 (+ 793us) server_negotiation.cc:299] Negotiation successful
0619 04:39:24.511519 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":386,"thread_start_us":268,"threads_started":1}
I20260619 04:39:24.513067 12736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:24.493295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:34327 (local address 127.9.224.65:47477)
0619 04:39:24.494017 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:24.494063 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:24.496164 (+ 2101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:24.497055 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:24.497065 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:24.497752 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:24.498491 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:24.498512 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:24.499633 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:24.499637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:24.500939 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:24.500952 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:24.501808 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:24.501818 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:24.502088 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:24.502897 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:24.502922 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:24.505229 (+ 2307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:24.508595 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:24.508606 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:24.508625 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:24.509115 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:24.509553 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:24.509558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:24.509562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:24.509788 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:24.510426 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:24.510435 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:24.510843 (+ 408us) client_negotiation.cc:769] Sending connection context
0619 04:39:24.511145 (+ 302us) client_negotiation.cc:240] Negotiation successful
0619 04:39:24.511746 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":269,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:39:24.514864 12733 heartbeater.cc:347] Connected to a master server at 127.9.224.126:34327
I20260619 04:39:24.515193 12733 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:24.515949 12733 heartbeater.cc:511] Master 127.9.224.126:34327 requested a full tablet report, sending...
I20260619 04:39:24.518397 12544 ts_manager.cc:194] Registered new tserver with Master: 53eef61f6a2646deb00e3a87a325276d (127.9.224.65:38825)
I20260619 04:39:24.521313 12544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:47477
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:24.541430 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34327
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:24.883342 12739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:24.883616 12739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:24.883769 12739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:24.891929 12739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:24.892035 12739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:24.892218 12739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:24.901961 12739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:24.903221 12739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:24.904585 12739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:24.917856 12744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:24.917776 12747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:24.917820 12745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:24.918812 12739 server_base.cc:1034] running on GCE node
I20260619 04:39:24.919389 12739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:24.920282 12739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:24.921478 12739 hybrid_clock.cc:648] HybridClock initialized: now 1781843964921427 us; error 45 us; skew 500 ppm
I20260619 04:39:24.921790 12739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:24 dist-test-slave-9dgf krb5kdc[12499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843964, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:24.924996 12739 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:24.926493 12739 webserver.cc:460] Webserver started at http://127.9.224.66:37117/ using document root <none> and password file <none>
I20260619 04:39:24.927271 12739 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:24.927373 12739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:24.927649 12739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:24.930867 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "52d18eb82bcc4611b99a0e5bc8fe79f6"
format_stamp: "Formatted at 2026-06-19 04:39:24 on dist-test-slave-9dgf"
server_key: "5fc2c114f964d42a440f22359ca111ac"
server_key_iv: "48111a88f0c32a041b792697bac12ecf"
server_key_version: "encryptionkey@0"
I20260619 04:39:24.931665 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "52d18eb82bcc4611b99a0e5bc8fe79f6"
format_stamp: "Formatted at 2026-06-19 04:39:24 on dist-test-slave-9dgf"
server_key: "5fc2c114f964d42a440f22359ca111ac"
server_key_iv: "48111a88f0c32a041b792697bac12ecf"
server_key_version: "encryptionkey@0"
I20260619 04:39:24.937299 12739 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:39:24.940973 12754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:24.942385 12739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:24.942562 12739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "52d18eb82bcc4611b99a0e5bc8fe79f6"
format_stamp: "Formatted at 2026-06-19 04:39:24 on dist-test-slave-9dgf"
server_key: "5fc2c114f964d42a440f22359ca111ac"
server_key_iv: "48111a88f0c32a041b792697bac12ecf"
server_key_version: "encryptionkey@0"
I20260619 04:39:24.942771 12739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:24.965233 12739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:24.969568 12739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:24.969883 12739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:24.970920 12739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:24.972223 12739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:24.972294 12739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:24.972376 12739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:24.972419 12739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:25.005663 12739 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:34867
I20260619 04:39:25.005748 12866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:34867 every 8 connection(s)
I20260619 04:39:25.007139 12739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:25.010933 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 12739
I20260619 04:39:25.011175 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:25.011725 10113 external_mini_cluster.cc:1428] Setting key 75e8eb3ed34efe006e25081fb68b3b86
Jun 19 04:39:25 dist-test-slave-9dgf krb5kdc[12499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843964, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:25.029332 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:25.010021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:34089 (local address 127.9.224.126:34327)
0619 04:39:25.010285 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:25.010295 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:25.011727 (+ 1432us) server_negotiation.cc:407] Connection header received
0619 04:39:25.013782 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:25.013791 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:25.013868 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:25.013924 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:25.015691 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.016827 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.018502 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.018952 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.019051 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:25.023521 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:25.023527 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:25.023530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:25.023561 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:25.026154 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:25.026922 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:25.026932 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:25.026934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:25.027110 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:25.027549 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:25.027554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:25.027558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:25.027830 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:25.027999 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:25.028761 (+ 762us) server_negotiation.cc:299] Negotiation successful
0619 04:39:25.028987 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
I20260619 04:39:25.030536 12869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:25.010589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:34327 (local address 127.9.224.66:34089)
0619 04:39:25.011529 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:25.011587 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:25.013423 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:25.014398 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:25.014407 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:25.014950 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:25.015514 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:25.015532 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.017004 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.017010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:25.018357 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:25.018369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.019187 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.019195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:25.019549 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:25.020290 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:25.020325 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:25.023274 (+ 2949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:25.026322 (+ 3048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:25.026331 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:25.026349 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:25.026788 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:25.027229 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:25.027234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:25.027238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:25.027431 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:25.027966 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:25.027973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:25.028391 (+ 418us) client_negotiation.cc:769] Sending connection context
0619 04:39:25.028673 (+ 282us) client_negotiation.cc:240] Negotiation successful
0619 04:39:25.029212 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":313,"threads_started":1}
I20260619 04:39:25.032102 12867 heartbeater.cc:347] Connected to a master server at 127.9.224.126:34327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
I20260619 04:39:25.032521 12867 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:25.033460 12867 heartbeater.cc:511] Master 127.9.224.126:34327 requested a full tablet report, sending...
I20260619 04:39:25.035236 12544 ts_manager.cc:194] Registered new tserver with Master: 52d18eb82bcc4611b99a0e5bc8fe79f6 (127.9.224.66:34867)
I20260619 04:39:25.036497 12544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:34089
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:25.057325 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34327
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:40775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:25.375321 12872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:25.375730 12872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:25.375931 12872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:25.383308 12872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:25.383412 12872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:25.383651 12872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:25.393394 12872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:25.394786 12872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:25.396131 12872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:25.410296 12877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:25.410334 12878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:25.410334 12880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:25.410732 12872 server_base.cc:1034] running on GCE node
I20260619 04:39:25.411638 12872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:25.412636 12872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:25.413870 12872 hybrid_clock.cc:648] HybridClock initialized: now 1781843965413805 us; error 59 us; skew 500 ppm
I20260619 04:39:25.414194 12872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:25 dist-test-slave-9dgf krb5kdc[12499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843965, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:25.417364 12872 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:25.418853 12872 webserver.cc:460] Webserver started at http://127.9.224.67:40117/ using document root <none> and password file <none>
I20260619 04:39:25.419590 12872 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:25.419736 12872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:25.420095 12872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:25.423312 12872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "85e01ed33392482cadbc996f9a7d337f"
format_stamp: "Formatted at 2026-06-19 04:39:25 on dist-test-slave-9dgf"
server_key: "53caf05450eedeea017b80cc453c41b6"
server_key_iv: "3a7cfdbc3b0abb98f8b77b180a86f068"
server_key_version: "encryptionkey@0"
I20260619 04:39:25.424211 12872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "85e01ed33392482cadbc996f9a7d337f"
format_stamp: "Formatted at 2026-06-19 04:39:25 on dist-test-slave-9dgf"
server_key: "53caf05450eedeea017b80cc453c41b6"
server_key_iv: "3a7cfdbc3b0abb98f8b77b180a86f068"
server_key_version: "encryptionkey@0"
I20260619 04:39:25.429656 12872 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:39:25.433223 12887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:25.434759 12872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:25.434937 12872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "85e01ed33392482cadbc996f9a7d337f"
format_stamp: "Formatted at 2026-06-19 04:39:25 on dist-test-slave-9dgf"
server_key: "53caf05450eedeea017b80cc453c41b6"
server_key_iv: "3a7cfdbc3b0abb98f8b77b180a86f068"
server_key_version: "encryptionkey@0"
I20260619 04:39:25.435150 12872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:25.453565 12872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:25.458034 12872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:25.458380 12872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:25.459311 12872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:25.460681 12872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:25.460785 12872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:25.460939 12872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:25.461019 12872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:25.496189 12872 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:38469
I20260619 04:39:25.496260 12999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:38469 every 8 connection(s)
I20260619 04:39:25.497416 12872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:25.505244 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 12872
I20260619 04:39:25.505455 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:25.505983 10113 external_mini_cluster.cc:1428] Setting key 79e0da7e7ac4f4c02b51aae66f166b9c
Jun 19 04:39:25 dist-test-slave-9dgf krb5kdc[12499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843965, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:25.517165 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:25.500006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:40507 (local address 127.9.224.126:34327)
0619 04:39:25.500182 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:25.500187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:25.501365 (+ 1178us) server_negotiation.cc:407] Connection header received
0619 04:39:25.503180 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:25.503184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:25.503278 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:25.503368 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:25.504776 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.505946 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.508084 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.508497 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.508592 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:25.512142 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:25.512148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:25.512151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:25.512183 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:25.514637 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:25.515277 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:25.515281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:25.515283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:25.515406 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:25.515765 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:25.515769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:25.515771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:25.516019 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:25.516135 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:25.516737 (+ 602us) server_negotiation.cc:299] Negotiation successful
0619 04:39:25.516896 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:39:25.518178 13002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:25.500507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:34327 (local address 127.9.224.67:40507)
0619 04:39:25.501214 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:25.501250 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:25.502915 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:25.503570 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:25.503577 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:25.504084 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:25.504627 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:25.504647 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.506154 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.506158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:25.507953 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:25.507972 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:25.508747 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:25.508755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:25.508987 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:25.509754 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:25.509780 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:25.511917 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:25.514758 (+ 2841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:25.514765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:25.514778 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:25.515174 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:25.515496 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:25.515499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:25.515502 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:25.515667 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:25.516117 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:25.516123 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:25.516423 (+ 300us) client_negotiation.cc:769] Sending connection context
0619 04:39:25.516655 (+ 232us) client_negotiation.cc:240] Negotiation successful
0619 04:39:25.517034 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":261,"threads_started":1}
I20260619 04:39:25.519647 13000 heartbeater.cc:347] Connected to a master server at 127.9.224.126:34327
I20260619 04:39:25.519958 13000 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:25.520787 13000 heartbeater.cc:511] Master 127.9.224.126:34327 requested a full tablet report, sending...
I20260619 04:39:25.522379 12544 ts_manager.cc:194] Registered new tserver with Master: 85e01ed33392482cadbc996f9a7d337f (127.9.224.67:38469)
I20260619 04:39:25.523233 12544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:40507
I20260619 04:39:25.525466 12733 heartbeater.cc:503] Master 127.9.224.126:34327 was elected leader, sending a full tablet report...
I20260619 04:39:25.533619 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 04:39:25.563695 12735 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:25.561356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45432 (local address 127.9.224.126:34327)
0619 04:39:25.561547 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:25.561551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:25.561979 (+ 428us) server_negotiation.cc:407] Connection header received
0619 04:39:25.562103 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:25.562107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:25.562173 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:25.562352 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:25.563509 (+ 1157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45432: BlockingRecv error: recv got EOF from 127.0.0.1:45432 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 04:39:25.566783 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12605
W20260619 04:39:25.569650 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12605: Not authorized: Client connection negotiation failed: client connection to 127.9.224.65:38825: server requires authentication, but client does not have Kerberos credentials available
I20260619 04:39:25.569854 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 12605
I20260619 04:39:25.585286 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12739
W20260619 04:39:25.587936 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12739: Not authorized: Client connection negotiation failed: client connection to 127.9.224.66:34867: server requires authentication, but client does not have Kerberos credentials available
I20260619 04:39:25.588116 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 12739
I20260619 04:39:25.603780 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12872
W20260619 04:39:25.606881 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12872: Not authorized: Client connection negotiation failed: client connection to 127.9.224.67:38469: server requires authentication, but client does not have Kerberos credentials available
I20260619 04:39:25.607049 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 12872
I20260619 04:39:25.622473 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 12512
I20260619 04:39:25.623732 12574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:25.727802 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 12512
2026-06-19T04:39:25Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3582 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:25 dist-test-slave-9dgf krb5kdc[13017](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:25 dist-test-slave-9dgf krb5kdc[13017](info): set up 2 sockets
Jun 19 04:39:25 dist-test-slave-9dgf krb5kdc[13017](info): commencing operation
krb5kdc: starting...
W20260619 04:39:26.834885 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:26 dist-test-slave-9dgf krb5kdc[13017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:27.033849 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:42355
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:42355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:27.353837 13030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:27.354135 13030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:27.354349 13030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:27.361691 13030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:27.361800 13030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:27.361891 13030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:27.361990 13030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:27.362078 13030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:27.372099 13030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:42355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:42355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:27.373437 13030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:27.374804 13030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:27.386978 13036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:27.387058 13035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:27.387085 13038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:27.388074 13030 server_base.cc:1034] running on GCE node
I20260619 04:39:27.388892 13030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:27.390359 13030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:27.391592 13030 hybrid_clock.cc:648] HybridClock initialized: now 1781843967391540 us; error 49 us; skew 500 ppm
I20260619 04:39:27.392025 13030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:27 dist-test-slave-9dgf krb5kdc[13017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843967, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:27.400409 13030 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:27.402114 13030 webserver.cc:460] Webserver started at http://127.9.224.126:43237/ using document root <none> and password file <none>
I20260619 04:39:27.402896 13030 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:27.403051 13030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:27.403374 13030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:27.406503 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "cbc798810ebe44edbe1eb7821882be75"
format_stamp: "Formatted at 2026-06-19 04:39:27 on dist-test-slave-9dgf"
server_key: "e26104a3ef6ff8355147b41fbbe47c33"
server_key_iv: "36c03186b8c5bd877633027851b0b36a"
server_key_version: "encryptionkey@0"
I20260619 04:39:27.407330 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "cbc798810ebe44edbe1eb7821882be75"
format_stamp: "Formatted at 2026-06-19 04:39:27 on dist-test-slave-9dgf"
server_key: "e26104a3ef6ff8355147b41fbbe47c33"
server_key_iv: "36c03186b8c5bd877633027851b0b36a"
server_key_version: "encryptionkey@0"
I20260619 04:39:27.413041 13030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:39:27.416706 13045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:27.418133 13030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 04:39:27.418380 13030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "cbc798810ebe44edbe1eb7821882be75"
format_stamp: "Formatted at 2026-06-19 04:39:27 on dist-test-slave-9dgf"
server_key: "e26104a3ef6ff8355147b41fbbe47c33"
server_key_iv: "36c03186b8c5bd877633027851b0b36a"
server_key_version: "encryptionkey@0"
I20260619 04:39:27.418599 13030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:27.433167 13030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:27.437743 13030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:27.438052 13030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:27.456905 13030 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:42355
I20260619 04:39:27.456949 13096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:42355 every 8 connection(s)
I20260619 04:39:27.458344 13030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:27.462273 13097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:27.463171 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13030
I20260619 04:39:27.463447 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:27.464350 10113 external_mini_cluster.cc:1428] Setting key c84b2e89c545d21f7b6d9e3591ce5619
I20260619 04:39:27.478161 13097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75: Bootstrap starting.
Jun 19 04:39:27 dist-test-slave-9dgf krb5kdc[13017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:27.482666 13097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:27.484333 13097 log.cc:824] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:27.488174 13097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75: No bootstrap required, opened a new log
I20260619 04:39:27.491494 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:27.466702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53440 (local address 127.9.224.126:42355)
0619 04:39:27.467521 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:27.467535 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:27.467582 (+ 47us) server_negotiation.cc:407] Connection header received
0619 04:39:27.469289 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:27.469314 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:27.469737 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:27.470364 (+ 627us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:27.472463 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:27.473800 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:27.475826 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:27.476553 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:27.476691 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:27.481778 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:27.481795 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:27.481817 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:27.481867 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:27.486165 (+ 4298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:27.486979 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:27.486988 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:27.486997 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:27.487246 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:27.487677 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:27.487685 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:27.487690 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:27.488514 (+ 824us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:27.488863 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:27.489388 (+ 525us) server_negotiation.cc:299] Negotiation successful
0619 04:39:27.489976 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":381,"threads_started":1}
I20260619 04:39:27.495818 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:39:27.497979 13097 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc798810ebe44edbe1eb7821882be75" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 42355 } }
I20260619 04:39:27.498425 13097 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:27.498553 13097 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc798810ebe44edbe1eb7821882be75, State: Initialized, Role: FOLLOWER
I20260619 04:39:27.499140 13097 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc798810ebe44edbe1eb7821882be75" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 42355 } }
I20260619 04:39:27.499374 13097 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:27.499501 13097 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:27.499668 13097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:27.501868 13097 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc798810ebe44edbe1eb7821882be75" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 42355 } }
I20260619 04:39:27.502463 13097 leader_election.cc:302] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbc798810ebe44edbe1eb7821882be75; no voters:
I20260619 04:39:27.503154 13097 leader_election.cc:288] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:27.503274 13103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:27.504593 13103 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [term 1 LEADER]: Becoming Leader. State: Replica: cbc798810ebe44edbe1eb7821882be75, State: Running, Role: LEADER
I20260619 04:39:27.505165 13103 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc798810ebe44edbe1eb7821882be75" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 42355 } }
I20260619 04:39:27.505698 13097 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:27.507965 13105 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbc798810ebe44edbe1eb7821882be75. Latest consensus state: current_term: 1 leader_uuid: "cbc798810ebe44edbe1eb7821882be75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc798810ebe44edbe1eb7821882be75" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 42355 } } }
I20260619 04:39:27.508389 13105 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:27.508486 13104 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbc798810ebe44edbe1eb7821882be75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc798810ebe44edbe1eb7821882be75" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 42355 } } }
I20260619 04:39:27.508848 13104 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:27.514015 13112 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:27.520095 13112 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:27.530393 13112 catalog_manager.cc:1347] Generated new cluster ID: e5afbaa4672a4c70b727f60201ac9f31
I20260619 04:39:27.530550 13112 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:27.547338 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:27.537101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53446 (local address 127.9.224.126:42355)
0619 04:39:27.537349 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:27.537356 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:27.537804 (+ 448us) server_negotiation.cc:407] Connection header received
0619 04:39:27.538099 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:27.538107 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:27.538211 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:27.538326 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:27.539852 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:27.540993 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:27.543126 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:27.543831 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:27.543972 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:27.545305 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:27.545312 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:27.545317 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:27.546192 (+ 875us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:27.546302 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:27.546338 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:27.546451 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:27.546607 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 04:39:27.546710 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260619 04:39:27.557691 13112 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:27.559463 13112 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:27.572561 13112 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbc798810ebe44edbe1eb7821882be75: Generated new TSK 0
I20260619 04:39:27.573451 13112 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:39:27.582477 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13030
I20260619 04:39:27.583532 13092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:27.675158 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13030
2026-06-19T04:39:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1940 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:27 dist-test-slave-9dgf krb5kdc[13131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:27 dist-test-slave-9dgf krb5kdc[13131](info): set up 2 sockets
Jun 19 04:39:27 dist-test-slave-9dgf krb5kdc[13131](info): commencing operation
krb5kdc: starting...
W20260619 04:39:28.762658 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.003s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:28 dist-test-slave-9dgf krb5kdc[13131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:28.966607 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:44933
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:44933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:29.304615 13144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:29.304980 13144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:29.305163 13144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:29.312604 13144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:29.312768 13144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:29.312877 13144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:29.312983 13144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:29.313069 13144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:29.323205 13144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:44933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:44933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:29.324657 13144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:29.326038 13144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:29.338569 13150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:29.338632 13149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:29.338685 13152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:29.339547 13144 server_base.cc:1034] running on GCE node
I20260619 04:39:29.340427 13144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:29.341907 13144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:29.343142 13144 hybrid_clock.cc:648] HybridClock initialized: now 1781843969343052 us; error 82 us; skew 500 ppm
I20260619 04:39:29.343502 13144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:29 dist-test-slave-9dgf krb5kdc[13131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843969, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:29.346689 13144 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:29.348112 13144 webserver.cc:460] Webserver started at http://127.9.224.126:42875/ using document root <none> and password file <none>
I20260619 04:39:29.348779 13144 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:29.348878 13144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:29.349126 13144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:29.352166 13144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "89671b7dbc934b33b758eabd49a790b6"
format_stamp: "Formatted at 2026-06-19 04:39:29 on dist-test-slave-9dgf"
server_key: "1f24c06c75364c3164a7b3b930049cf4"
server_key_iv: "c467c8841424de8eff3bb9e002897404"
server_key_version: "encryptionkey@0"
I20260619 04:39:29.352890 13144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "89671b7dbc934b33b758eabd49a790b6"
format_stamp: "Formatted at 2026-06-19 04:39:29 on dist-test-slave-9dgf"
server_key: "1f24c06c75364c3164a7b3b930049cf4"
server_key_iv: "c467c8841424de8eff3bb9e002897404"
server_key_version: "encryptionkey@0"
I20260619 04:39:29.358335 13144 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:39:29.361774 13159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:29.363366 13144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:29.363556 13144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "89671b7dbc934b33b758eabd49a790b6"
format_stamp: "Formatted at 2026-06-19 04:39:29 on dist-test-slave-9dgf"
server_key: "1f24c06c75364c3164a7b3b930049cf4"
server_key_iv: "c467c8841424de8eff3bb9e002897404"
server_key_version: "encryptionkey@0"
I20260619 04:39:29.363763 13144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:29.377600 13144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:29.381806 13144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:29.382112 13144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:29.400883 13144 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:44933
I20260619 04:39:29.400902 13210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:44933 every 8 connection(s)
I20260619 04:39:29.402453 13144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:29.406416 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13144
I20260619 04:39:29.406528 13211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:29.406675 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:29.407505 10113 external_mini_cluster.cc:1428] Setting key 350eea465f1c661b4e8d99931a2eb6de
I20260619 04:39:29.422355 13211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6: Bootstrap starting.
Jun 19 04:39:29 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:29.426473 13211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:29.427886 13211 log.cc:824] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:29.431515 13211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6: No bootstrap required, opened a new log
I20260619 04:39:29.432654 13214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:29.409663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.9.224.126:44933)
0619 04:39:29.410542 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:29.410557 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:29.410606 (+ 49us) server_negotiation.cc:407] Connection header received
0619 04:39:29.412250 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:29.412284 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:29.412841 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:29.413308 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:29.414558 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:29.416507 (+ 1949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:29.417922 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:29.418809 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:29.418960 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:29.423888 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:29.423901 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:29.423929 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:29.423992 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:29.428019 (+ 4027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:29.428897 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:29.428903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:29.428910 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:29.429078 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:29.429496 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:29.429501 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:29.429504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:29.430202 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:29.430542 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:29.430842 (+ 300us) server_negotiation.cc:299] Negotiation successful
0619 04:39:29.431271 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":372,"threads_started":1}
I20260619 04:39:29.440214 13211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89671b7dbc934b33b758eabd49a790b6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44933 } }
I20260619 04:39:29.440578 13211 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:29.440651 13211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89671b7dbc934b33b758eabd49a790b6, State: Initialized, Role: FOLLOWER
I20260619 04:39:29.441215 13211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89671b7dbc934b33b758eabd49a790b6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44933 } }
I20260619 04:39:29.441419 13211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:29.441507 13211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:29.441664 13211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:29.444078 13211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89671b7dbc934b33b758eabd49a790b6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44933 } }
I20260619 04:39:29.444597 13211 leader_election.cc:302] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89671b7dbc934b33b758eabd49a790b6; no voters:
I20260619 04:39:29.445154 13211 leader_election.cc:288] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:29.445294 13216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:29.446071 13216 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [term 1 LEADER]: Becoming Leader. State: Replica: 89671b7dbc934b33b758eabd49a790b6, State: Running, Role: LEADER
I20260619 04:39:29.446645 13216 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89671b7dbc934b33b758eabd49a790b6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44933 } }
I20260619 04:39:29.447355 13211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:29.449647 13218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89671b7dbc934b33b758eabd49a790b6. Latest consensus state: current_term: 1 leader_uuid: "89671b7dbc934b33b758eabd49a790b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89671b7dbc934b33b758eabd49a790b6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44933 } } }
I20260619 04:39:29.450100 13218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:29.450443 13217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89671b7dbc934b33b758eabd49a790b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89671b7dbc934b33b758eabd49a790b6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44933 } } }
I20260619 04:39:29.450822 13217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:29.455010 13223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:29.461331 13223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:29.469892 13223 catalog_manager.cc:1347] Generated new cluster ID: 680463a6bd7344d1a217868dea564016
I20260619 04:39:29.470016 13223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:29.490967 13223 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:29.492529 13223 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:29.501216 13223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89671b7dbc934b33b758eabd49a790b6: Generated new TSK 0
I20260619 04:39:29.502377 13223 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:29.567986 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44933
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:29.905121 13237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:29.905443 13237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:29.905614 13237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:29.913072 13237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:29.913230 13237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:29.913419 13237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:29.923477 13237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:29.924870 13237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:29.926276 13237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:29.940806 13242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:29.940872 13243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:29.940902 13245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:29.941780 13237 server_base.cc:1034] running on GCE node
I20260619 04:39:29.942500 13237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:29.943557 13237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:29.944792 13237 hybrid_clock.cc:648] HybridClock initialized: now 1781843969944725 us; error 65 us; skew 500 ppm
I20260619 04:39:29.945134 13237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:29 dist-test-slave-9dgf krb5kdc[13131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843969, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:29.948563 13237 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:29.950183 13237 webserver.cc:460] Webserver started at http://127.9.224.65:45457/ using document root <none> and password file <none>
I20260619 04:39:29.950977 13237 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:29.951130 13237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:29.951445 13237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:29.954559 13237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "4f8d52f91b3f494099b41c91979e30b8"
format_stamp: "Formatted at 2026-06-19 04:39:29 on dist-test-slave-9dgf"
server_key: "8eda032aa18097d665c0697256ab04cd"
server_key_iv: "d1ed458499fff28999b02bea4ebf3105"
server_key_version: "encryptionkey@0"
I20260619 04:39:29.955650 13237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "4f8d52f91b3f494099b41c91979e30b8"
format_stamp: "Formatted at 2026-06-19 04:39:29 on dist-test-slave-9dgf"
server_key: "8eda032aa18097d665c0697256ab04cd"
server_key_iv: "d1ed458499fff28999b02bea4ebf3105"
server_key_version: "encryptionkey@0"
I20260619 04:39:29.961167 13237 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:39:29.964749 13252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:29.966409 13237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:29.966589 13237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "4f8d52f91b3f494099b41c91979e30b8"
format_stamp: "Formatted at 2026-06-19 04:39:29 on dist-test-slave-9dgf"
server_key: "8eda032aa18097d665c0697256ab04cd"
server_key_iv: "d1ed458499fff28999b02bea4ebf3105"
server_key_version: "encryptionkey@0"
I20260619 04:39:29.966817 13237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:30.000506 13237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:30.004863 13237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:30.005174 13237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:30.006126 13237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:30.007501 13237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:30.007606 13237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:30.007752 13237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:30.007825 13237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:30.040464 13237 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:34049
I20260619 04:39:30.040524 13364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:34049 every 8 connection(s)
I20260619 04:39:30.041769 13237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:30.049923 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13237
I20260619 04:39:30.050138 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:30.050781 10113 external_mini_cluster.cc:1428] Setting key a4f029008baabdfc4fea43587c812ee7
Jun 19 04:39:30 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843969, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:30.063187 13367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:30.044327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:39009 (local address 127.9.224.126:44933)
0619 04:39:30.044823 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:30.044827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:30.045713 (+ 886us) server_negotiation.cc:407] Connection header received
0619 04:39:30.047726 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:30.047731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:30.047825 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:30.047937 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:30.049448 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.050229 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.052026 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.052594 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.052720 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:30.056719 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:30.056727 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:30.056735 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:30.056782 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:30.059793 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:30.060771 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:30.060776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:30.060778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:30.060899 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:30.061370 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:30.061373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:30.061375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:30.061671 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:30.061782 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:30.062749 (+ 967us) server_negotiation.cc:299] Negotiation successful
0619 04:39:30.062917 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":297,"threads_started":1}
I20260619 04:39:30.064864 13368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:30.044886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44933 (local address 127.9.224.65:39009)
0619 04:39:30.045548 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:30.045595 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:30.047412 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:30.048186 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:30.048194 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:30.048738 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:30.049284 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:30.049300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.050406 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.050410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:30.051876 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:30.051891 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.052879 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.052887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:30.053125 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:30.053836 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:30.053864 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:30.056487 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:30.059948 (+ 3461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:30.059962 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:30.059983 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:30.060649 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:30.061008 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:30.061015 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:30.061022 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:30.061267 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:30.061813 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:30.061824 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:30.062345 (+ 521us) client_negotiation.cc:769] Sending connection context
0619 04:39:30.062665 (+ 320us) client_negotiation.cc:240] Negotiation successful
0619 04:39:30.063268 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":276,"threads_started":1}
I20260619 04:39:30.066709 13365 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44933
I20260619 04:39:30.067049 13365 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:30.067932 13365 heartbeater.cc:511] Master 127.9.224.126:44933 requested a full tablet report, sending...
I20260619 04:39:30.070633 13176 ts_manager.cc:194] Registered new tserver with Master: 4f8d52f91b3f494099b41c91979e30b8 (127.9.224.65:34049)
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:30.072499 13176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:39009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:30.098371 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44933
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:30.428987 13371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:30.429343 13371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:30.429533 13371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:30.437175 13371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:30.437371 13371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:30.437574 13371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:30.448000 13371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:30.449503 13371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:30.450974 13371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:30.468775 13376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:30.468837 13377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:30.469090 13379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:30.470589 13371 server_base.cc:1034] running on GCE node
I20260619 04:39:30.471556 13371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:30.472981 13371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:30.474212 13371 hybrid_clock.cc:648] HybridClock initialized: now 1781843970474127 us; error 73 us; skew 500 ppm
I20260619 04:39:30.474706 13371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:30 dist-test-slave-9dgf krb5kdc[13131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843970, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:30.479156 13371 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:30.481798 13371 webserver.cc:460] Webserver started at http://127.9.224.66:34045/ using document root <none> and password file <none>
I20260619 04:39:30.482959 13371 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:30.483129 13371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:30.483558 13371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:30.488026 13371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "3f6ffa8af4594a61a66d86af496c55d6"
format_stamp: "Formatted at 2026-06-19 04:39:30 on dist-test-slave-9dgf"
server_key: "7b7d4c95ecd1d9ffb246958c6d794728"
server_key_iv: "3f80d14b9c55c5c2d9a727dfd24417d3"
server_key_version: "encryptionkey@0"
I20260619 04:39:30.488915 13371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "3f6ffa8af4594a61a66d86af496c55d6"
format_stamp: "Formatted at 2026-06-19 04:39:30 on dist-test-slave-9dgf"
server_key: "7b7d4c95ecd1d9ffb246958c6d794728"
server_key_iv: "3f80d14b9c55c5c2d9a727dfd24417d3"
server_key_version: "encryptionkey@0"
I20260619 04:39:30.497069 13371 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
I20260619 04:39:30.502702 13386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:30.504804 13371 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:39:30.505008 13371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "3f6ffa8af4594a61a66d86af496c55d6"
format_stamp: "Formatted at 2026-06-19 04:39:30 on dist-test-slave-9dgf"
server_key: "7b7d4c95ecd1d9ffb246958c6d794728"
server_key_iv: "3f80d14b9c55c5c2d9a727dfd24417d3"
server_key_version: "encryptionkey@0"
I20260619 04:39:30.505271 13371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:30.533769 13371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:30.538725 13371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:30.539038 13371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:30.540055 13371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:30.541432 13371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:30.541538 13371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:30.541683 13371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:30.541752 13371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:30.576344 13371 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:44519
I20260619 04:39:30.576392 13498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:44519 every 8 connection(s)
I20260619 04:39:30.577667 13371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:30.588133 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13371
I20260619 04:39:30.588318 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:30.588932 10113 external_mini_cluster.cc:1428] Setting key 515766bfc6fbf3d5986cbfa647536d02
Jun 19 04:39:30 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843970, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:30.601743 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:30.580605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:57709 (local address 127.9.224.126:44933)
0619 04:39:30.581067 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:30.581072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:30.582287 (+ 1215us) server_negotiation.cc:407] Connection header received
0619 04:39:30.584247 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:30.584251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:30.584331 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:30.584436 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:30.586385 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.587220 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.589653 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.590282 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.590430 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:30.595021 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:30.595027 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:30.595031 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:30.595068 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:30.598061 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:30.598988 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:30.598996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:30.599003 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:30.599167 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:30.599663 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:30.599671 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:30.599678 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:30.600074 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:30.600234 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:30.600976 (+ 742us) server_negotiation.cc:299] Negotiation successful
0619 04:39:30.601248 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":228,"threads_started":1}
I20260619 04:39:30.602607 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:30.581230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44933 (local address 127.9.224.66:57709)
0619 04:39:30.582074 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:30.582119 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:30.583937 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:30.584724 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:30.584732 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:30.585383 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:30.586133 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:30.586153 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.587402 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.587406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:30.589464 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:30.589480 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:30.590536 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:30.590544 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:30.590853 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:30.591655 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:30.591688 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:30.594698 (+ 3010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:30.598302 (+ 3604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:30.598311 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:30.598328 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:30.598827 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:30.599307 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:30.599311 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:30.599313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:30.599513 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:30.600210 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:30.600217 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:30.600572 (+ 355us) client_negotiation.cc:769] Sending connection context
0619 04:39:30.600808 (+ 236us) client_negotiation.cc:240] Negotiation successful
0619 04:39:30.601248 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":306,"threads_started":1}
I20260619 04:39:30.604159 13499 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44933
I20260619 04:39:30.604517 13499 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:30.605545 13499 heartbeater.cc:511] Master 127.9.224.126:44933 requested a full tablet report, sending...
I20260619 04:39:30.607429 13176 ts_manager.cc:194] Registered new tserver with Master: 3f6ffa8af4594a61a66d86af496c55d6 (127.9.224.66:44519)
I20260619 04:39:30.608700 13176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:57709
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:30.638118 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44933
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:30.980480 13505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:30.980816 13505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:30.980985 13505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:30.988310 13505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:30.988472 13505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:30.988667 13505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:30.999014 13505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:31.000355 13505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:31.001693 13505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:31.015360 13511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:31.015417 13513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:31.015386 13510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:31.016564 13505 server_base.cc:1034] running on GCE node
I20260619 04:39:31.017251 13505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:31.018329 13505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:31.019567 13505 hybrid_clock.cc:648] HybridClock initialized: now 1781843971019513 us; error 48 us; skew 500 ppm
I20260619 04:39:31.019905 13505 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:31.023245 13505 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:31.024766 13505 webserver.cc:460] Webserver started at http://127.9.224.67:37395/ using document root <none> and password file <none>
I20260619 04:39:31.025480 13505 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:31.025627 13505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:31.025954 13505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:31.028982 13505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "b69b4ab8bf7544d383bfabfedbee86f3"
format_stamp: "Formatted at 2026-06-19 04:39:31 on dist-test-slave-9dgf"
server_key: "74c642c6f1bd04b48ff4b541af471bb8"
server_key_iv: "fe73539be4a1e2b4773937f056d2a558"
server_key_version: "encryptionkey@0"
I20260619 04:39:31.029788 13505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "b69b4ab8bf7544d383bfabfedbee86f3"
format_stamp: "Formatted at 2026-06-19 04:39:31 on dist-test-slave-9dgf"
server_key: "74c642c6f1bd04b48ff4b541af471bb8"
server_key_iv: "fe73539be4a1e2b4773937f056d2a558"
server_key_version: "encryptionkey@0"
I20260619 04:39:31.035014 13505 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 04:39:31.038630 13520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:31.040088 13505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:39:31.040282 13505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "b69b4ab8bf7544d383bfabfedbee86f3"
format_stamp: "Formatted at 2026-06-19 04:39:31 on dist-test-slave-9dgf"
server_key: "74c642c6f1bd04b48ff4b541af471bb8"
server_key_iv: "fe73539be4a1e2b4773937f056d2a558"
server_key_version: "encryptionkey@0"
I20260619 04:39:31.040500 13505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:31.060477 13505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:31.064532 13505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:31.064872 13505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:31.065905 13505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:31.067478 13505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:31.067580 13505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:31.067726 13505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:31.067797 13505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:31.075623 13365 heartbeater.cc:503] Master 127.9.224.126:44933 was elected leader, sending a full tablet report...
I20260619 04:39:31.101212 13505 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:35173
I20260619 04:39:31.101256 13632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:35173 every 8 connection(s)
I20260619 04:39:31.102571 13505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:31.107735 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13505
I20260619 04:39:31.107923 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:31.108383 10113 external_mini_cluster.cc:1428] Setting key 5eec68ecdb972e9ea5de9f6b856d3192
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:31.123988 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:31.105155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:35581 (local address 127.9.224.126:44933)
0619 04:39:31.105602 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:31.105607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:31.106661 (+ 1054us) server_negotiation.cc:407] Connection header received
0619 04:39:31.108619 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:31.108626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:31.108740 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:31.108867 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:31.111074 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.112141 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.113653 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.114058 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.114166 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:31.117674 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:31.117678 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:31.117681 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:31.117714 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:31.120437 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.121172 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.121175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.121178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.121297 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.121736 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.121740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.121742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.122153 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:31.122355 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:31.123314 (+ 959us) server_negotiation.cc:299] Negotiation successful
0619 04:39:31.123583 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":223,"threads_started":1}
I20260619 04:39:31.124984 13636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:31.105726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44933 (local address 127.9.224.67:35581)
0619 04:39:31.106463 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:31.106506 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:31.108313 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:31.109218 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:31.109234 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:31.110001 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:31.110879 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:31.110905 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.112280 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.112283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:31.113497 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:31.113508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.114376 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.114383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:31.114592 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:31.115322 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:31.115348 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:31.117480 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:31.120572 (+ 3092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:31.120579 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:31.120593 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:31.121039 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:31.121398 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:31.121402 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:31.121404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:31.121589 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:31.122331 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:31.122338 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:31.122779 (+ 441us) client_negotiation.cc:769] Sending connection context
0619 04:39:31.123155 (+ 376us) client_negotiation.cc:240] Negotiation successful
0619 04:39:31.123671 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":268,"threads_started":1}
I20260619 04:39:31.126426 13633 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44933
I20260619 04:39:31.126757 13633 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:31.127521 13633 heartbeater.cc:511] Master 127.9.224.126:44933 requested a full tablet report, sending...
I20260619 04:39:31.128950 13176 ts_manager.cc:194] Registered new tserver with Master: b69b4ab8bf7544d383bfabfedbee86f3 (127.9.224.67:35173)
I20260619 04:39:31.129732 13176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:35581
I20260619 04:39:31.137007 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:31.186380 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:31.172733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33152 (local address 127.9.224.126:44933)
0619 04:39:31.172948 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:31.172953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:31.173406 (+ 453us) server_negotiation.cc:407] Connection header received
0619 04:39:31.173610 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:31.173614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:31.173700 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:31.173806 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:31.175268 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.176020 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.177249 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.177672 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.177779 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:31.181461 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:31.181466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:31.181470 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:31.181504 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:31.184119 (+ 2615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.184700 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.184704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.184706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.184827 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.185165 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.185168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.185170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.185475 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:31.185655 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:31.185908 (+ 253us) server_negotiation.cc:299] Negotiation successful
0619 04:39:31.186081 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260619 04:39:31.187001 13176 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33152
I20260619 04:39:31.188874 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13237
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:31.204090 13645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:31.189756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50930 (local address 127.9.224.65:34049)
0619 04:39:31.190399 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:31.190406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:31.190430 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:39:31.190485 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:31.190492 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:31.190714 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:31.190839 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:31.191935 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.192916 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.194068 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.194716 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.194813 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:31.198593 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:31.198604 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:31.198618 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:31.198654 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:31.201493 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.202131 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.202137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.202139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.202334 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.202646 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.202649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.202651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.202969 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:31.203193 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:31.203466 (+ 273us) server_negotiation.cc:299] Negotiation successful
0619 04:39:31.203655 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":279,"threads_started":1}
W20260619 04:39:31.205395 13360 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50930
W20260619 04:39:31.206496 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13237: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:31.206739 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13237
I20260619 04:39:31.222760 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13371
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:31.238520 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:31.223680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.9.224.66:44519)
0619 04:39:31.224189 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:31.224197 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:31.224221 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:39:31.224280 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:31.224286 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:31.224509 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:31.224678 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:31.225895 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.226984 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.228233 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.228788 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.228922 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:31.232968 (+ 4046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:31.232979 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:31.232995 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:31.233030 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:31.235768 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.236436 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.236443 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.236446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.236574 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.236946 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.236951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.236954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.237284 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:31.237616 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:31.237874 (+ 258us) server_negotiation.cc:299] Negotiation successful
0619 04:39:31.238144 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":247,"threads_started":1}
W20260619 04:39:31.239789 13494 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36904
W20260619 04:39:31.240888 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13371: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:31.241029 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13371
I20260619 04:39:31.256524 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13505
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843971, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:31.273115 13647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:31.257465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50246 (local address 127.9.224.67:35173)
0619 04:39:31.258156 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:31.258163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:31.258192 (+ 29us) server_negotiation.cc:407] Connection header received
0619 04:39:31.258303 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:31.258309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:31.258572 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:31.258706 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:31.259947 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.261034 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.262359 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:31.262948 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:31.263065 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:31.267480 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:31.267499 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:31.267526 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:31.267563 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:31.270603 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.271276 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.271284 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.271286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.271407 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:31.271742 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:31.271745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:31.271747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:31.272083 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:31.272338 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:31.272594 (+ 256us) server_negotiation.cc:299] Negotiation successful
0619 04:39:31.272790 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":319,"threads_started":1}
W20260619 04:39:31.274433 13628 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50246
W20260619 04:39:31.275590 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13505: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:39:31.275774 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13505
I20260619 04:39:31.291064 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13144
I20260619 04:39:31.292275 13206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:31.394615 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13144
2026-06-19T04:39:31Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3724 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13651](info): set up 2 sockets
Jun 19 04:39:31 dist-test-slave-9dgf krb5kdc[13651](info): commencing operation
krb5kdc: starting...
W20260619 04:39:32.506610 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:32 dist-test-slave-9dgf krb5kdc[13651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:32.708135 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:33479
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:33479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:33.038851 13664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:33.039161 13664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:33.039326 13664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:33.046741 13664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:33.046854 13664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:33.046943 13664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:33.047052 13664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:33.047118 13664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:33.057220 13664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:33479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:33479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:33.058724 13664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:33.060063 13664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:33.072696 13672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:33.072803 13669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:33.072785 13670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:33.073688 13664 server_base.cc:1034] running on GCE node
I20260619 04:39:33.074568 13664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:33.076045 13664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:33.077288 13664 hybrid_clock.cc:648] HybridClock initialized: now 1781843973077240 us; error 36 us; skew 500 ppm
I20260619 04:39:33.077643 13664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:33 dist-test-slave-9dgf krb5kdc[13651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843973, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:33.084817 13664 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:33.086551 13664 webserver.cc:460] Webserver started at http://127.9.224.126:34911/ using document root <none> and password file <none>
I20260619 04:39:33.087311 13664 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:33.087459 13664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:33.087837 13664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:33.091005 13664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "7f17ed35a9254a0d9efed6e4516b619d"
format_stamp: "Formatted at 2026-06-19 04:39:33 on dist-test-slave-9dgf"
server_key: "2d97acb16bc7a949c5a5853163469339"
server_key_iv: "8b7538b6372cbe3289b174fa58a99519"
server_key_version: "encryptionkey@0"
I20260619 04:39:33.091832 13664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "7f17ed35a9254a0d9efed6e4516b619d"
format_stamp: "Formatted at 2026-06-19 04:39:33 on dist-test-slave-9dgf"
server_key: "2d97acb16bc7a949c5a5853163469339"
server_key_iv: "8b7538b6372cbe3289b174fa58a99519"
server_key_version: "encryptionkey@0"
I20260619 04:39:33.097270 13664 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:39:33.100813 13679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:33.102344 13664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:33.102527 13664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "7f17ed35a9254a0d9efed6e4516b619d"
format_stamp: "Formatted at 2026-06-19 04:39:33 on dist-test-slave-9dgf"
server_key: "2d97acb16bc7a949c5a5853163469339"
server_key_iv: "8b7538b6372cbe3289b174fa58a99519"
server_key_version: "encryptionkey@0"
I20260619 04:39:33.102778 13664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:33.119130 13664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:33.123508 13664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:33.123811 13664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:33.142804 13664 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:33479
I20260619 04:39:33.142834 13730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:33479 every 8 connection(s)
I20260619 04:39:33.144218 13664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:33.147989 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:33.148005 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13664
I20260619 04:39:33.148273 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:33.148918 10113 external_mini_cluster.cc:1428] Setting key 07bd869b41ed8363ef8faf1b496cb913
I20260619 04:39:33.162315 13731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d: Bootstrap starting.
Jun 19 04:39:33 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:33.165586 13731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:33.166960 13731 log.cc:824] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:33.170574 13731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d: No bootstrap required, opened a new log
I20260619 04:39:33.175100 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:33.151110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.9.224.126:33479)
0619 04:39:33.151893 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:33.151909 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:33.151961 (+ 52us) server_negotiation.cc:407] Connection header received
0619 04:39:33.154614 (+ 2653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:33.154641 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:33.155146 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:33.155597 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:33.156864 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:33.158925 (+ 2061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:33.160374 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:33.161417 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:33.161595 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:33.166138 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:33.166150 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:33.166168 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:33.166211 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:33.170308 (+ 4097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:33.171091 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:33.171100 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:33.171108 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:33.171329 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:33.171736 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:33.171741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:33.171744 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:33.172426 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:33.172725 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:33.173208 (+ 483us) server_negotiation.cc:299] Negotiation successful
0619 04:39:33.173674 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":333,"threads_started":1}
I20260619 04:39:33.179705 13731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f17ed35a9254a0d9efed6e4516b619d" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33479 } }
I20260619 04:39:33.180052 13731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:33.180128 13731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f17ed35a9254a0d9efed6e4516b619d, State: Initialized, Role: FOLLOWER
I20260619 04:39:33.180677 13731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f17ed35a9254a0d9efed6e4516b619d" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33479 } }
I20260619 04:39:33.180886 13731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:33.180982 13731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:33.181097 13731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:33.183632 13731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f17ed35a9254a0d9efed6e4516b619d" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33479 } }
I20260619 04:39:33.184109 13731 leader_election.cc:302] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f17ed35a9254a0d9efed6e4516b619d; no voters:
I20260619 04:39:33.184697 13731 leader_election.cc:288] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:33.184886 13736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:33.185736 13736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [term 1 LEADER]: Becoming Leader. State: Replica: 7f17ed35a9254a0d9efed6e4516b619d, State: Running, Role: LEADER
I20260619 04:39:33.186359 13736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f17ed35a9254a0d9efed6e4516b619d" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33479 } }
I20260619 04:39:33.187091 13731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:33.189281 13738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f17ed35a9254a0d9efed6e4516b619d. Latest consensus state: current_term: 1 leader_uuid: "7f17ed35a9254a0d9efed6e4516b619d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f17ed35a9254a0d9efed6e4516b619d" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33479 } } }
I20260619 04:39:33.189699 13738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:33.189241 13737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f17ed35a9254a0d9efed6e4516b619d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f17ed35a9254a0d9efed6e4516b619d" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33479 } } }
I20260619 04:39:33.189934 13737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:33.192970 13743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:33.199833 13743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:33.210414 13743 catalog_manager.cc:1347] Generated new cluster ID: 53e8e0bdd5754e549180ee6b9575304d
I20260619 04:39:33.210529 13743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:33.220906 13743 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:33.222214 13743 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:33.229398 13743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f17ed35a9254a0d9efed6e4516b619d: Generated new TSK 0
I20260619 04:39:33.230463 13743 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:33.297402 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:33479
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:33.628281 13757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:33.628662 13757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:33.628850 13757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:33.636303 13757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:33.636456 13757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:33.636646 13757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:33.647410 13757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:33479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:33.648779 13757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:33.650118 13757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:33.663607 13762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:33.663655 13763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:33.663565 13765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:33.664916 13757 server_base.cc:1034] running on GCE node
I20260619 04:39:33.665647 13757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:33.666707 13757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:33.667937 13757 hybrid_clock.cc:648] HybridClock initialized: now 1781843973667890 us; error 45 us; skew 500 ppm
I20260619 04:39:33.668272 13757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:33 dist-test-slave-9dgf krb5kdc[13651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843973, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:33.671425 13757 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:33.672960 13757 webserver.cc:460] Webserver started at http://127.9.224.65:38521/ using document root <none> and password file <none>
I20260619 04:39:33.673668 13757 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:33.673820 13757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:33.674129 13757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:33.677213 13757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "cf405a33a4964c978151147b24bf26bc"
format_stamp: "Formatted at 2026-06-19 04:39:33 on dist-test-slave-9dgf"
server_key: "d49a7ec0da7ec3fea1c9a3f430959b6c"
server_key_iv: "66ee102cf6a22bef8a8e863e5fe31f34"
server_key_version: "encryptionkey@0"
I20260619 04:39:33.678030 13757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "cf405a33a4964c978151147b24bf26bc"
format_stamp: "Formatted at 2026-06-19 04:39:33 on dist-test-slave-9dgf"
server_key: "d49a7ec0da7ec3fea1c9a3f430959b6c"
server_key_iv: "66ee102cf6a22bef8a8e863e5fe31f34"
server_key_version: "encryptionkey@0"
I20260619 04:39:33.683223 13757 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:39:33.686800 13772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:33.688215 13757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:39:33.688409 13757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "cf405a33a4964c978151147b24bf26bc"
format_stamp: "Formatted at 2026-06-19 04:39:33 on dist-test-slave-9dgf"
server_key: "d49a7ec0da7ec3fea1c9a3f430959b6c"
server_key_iv: "66ee102cf6a22bef8a8e863e5fe31f34"
server_key_version: "encryptionkey@0"
I20260619 04:39:33.688635 13757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:33.720075 13757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:33.724654 13757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:33.724969 13757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:33.726045 13757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:33.727530 13757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:33.727638 13757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:33.727806 13757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:33.727893 13757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:33.763455 13757 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:42745
I20260619 04:39:33.763495 13884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:42745 every 8 connection(s)
I20260619 04:39:33.764807 13757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:33.767503 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13757
I20260619 04:39:33.767725 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:33.768357 10113 external_mini_cluster.cc:1428] Setting key feb054eaf054e9d48be389de1abfb146
Jun 19 04:39:33 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843973, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:33.786006 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:33.767502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:58263 (local address 127.9.224.126:33479)
0619 04:39:33.769267 (+ 1765us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:33.769275 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:33.769436 (+ 161us) server_negotiation.cc:407] Connection header received
0619 04:39:33.771860 (+ 2424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:33.771865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:33.771937 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:33.772077 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:33.773731 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:33.774548 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:33.776162 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:33.776581 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:33.776725 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:33.780253 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:33.780259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:33.780262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:33.780296 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:33.782892 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:33.783663 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:33.783669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:33.783673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:33.783812 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:33.784255 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:33.784261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:33.784265 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:33.784543 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:33.784700 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:33.785418 (+ 718us) server_negotiation.cc:299] Negotiation successful
0619 04:39:33.785643 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1635,"thread_start_us":1516,"threads_started":1}
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:33.787201 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:33.768270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:33479 (local address 127.9.224.65:58263)
0619 04:39:33.769243 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:33.769300 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:33.771524 (+ 2224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:33.772352 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:33.772361 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:33.772974 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:33.773554 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:33.773572 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:33.774713 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:33.774717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:33.776011 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:33.776024 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:33.776817 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:33.776826 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:33.777084 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:33.777802 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:33.777824 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:33.780019 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:33.783040 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:33.783051 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:33.783070 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:33.783535 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:33.783935 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:33.783940 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:33.783944 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:33.784140 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:33.784674 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:33.784682 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:33.785042 (+ 360us) client_negotiation.cc:769] Sending connection context
0619 04:39:33.785328 (+ 286us) client_negotiation.cc:240] Negotiation successful
0619 04:39:33.785879 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":386,"threads_started":1}
I20260619 04:39:33.788911 13885 heartbeater.cc:347] Connected to a master server at 127.9.224.126:33479
I20260619 04:39:33.789188 13885 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:39:33.789925 13885 heartbeater.cc:511] Master 127.9.224.126:33479 requested a full tablet report, sending...
I20260619 04:39:33.792229 13696 ts_manager.cc:194] Registered new tserver with Master: cf405a33a4964c978151147b24bf26bc (127.9.224.65:42745)
I20260619 04:39:33.793771 13696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:58263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:33.813621 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:33479
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:34.141793 13891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:34.142174 13891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:34.142423 13891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:34.149991 13891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:34.150175 13891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:34.150391 13891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:34.160504 13891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:33479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:34.161927 13891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:34.163376 13891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:34.177032 13896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:34.177021 13897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:34.177062 13899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:34.177855 13891 server_base.cc:1034] running on GCE node
I20260619 04:39:34.178553 13891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:34.179569 13891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:34.180789 13891 hybrid_clock.cc:648] HybridClock initialized: now 1781843974180741 us; error 40 us; skew 500 ppm
I20260619 04:39:34.181142 13891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:34.184474 13891 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:34.186043 13891 webserver.cc:460] Webserver started at http://127.9.224.66:35229/ using document root <none> and password file <none>
I20260619 04:39:34.186877 13891 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:34.186983 13891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:34.187361 13891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:34.190560 13891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "ca6d50bab8b946b4b5814c11bae7719b"
format_stamp: "Formatted at 2026-06-19 04:39:34 on dist-test-slave-9dgf"
server_key: "b8569fe606f2602f454bc0ee3a6f2862"
server_key_iv: "8a872f34889bcd9b7bce4530de7d4b7e"
server_key_version: "encryptionkey@0"
I20260619 04:39:34.191330 13891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "ca6d50bab8b946b4b5814c11bae7719b"
format_stamp: "Formatted at 2026-06-19 04:39:34 on dist-test-slave-9dgf"
server_key: "b8569fe606f2602f454bc0ee3a6f2862"
server_key_iv: "8a872f34889bcd9b7bce4530de7d4b7e"
server_key_version: "encryptionkey@0"
I20260619 04:39:34.197468 13891 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260619 04:39:34.201571 13906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:34.203291 13891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:34.203491 13891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "ca6d50bab8b946b4b5814c11bae7719b"
format_stamp: "Formatted at 2026-06-19 04:39:34 on dist-test-slave-9dgf"
server_key: "b8569fe606f2602f454bc0ee3a6f2862"
server_key_iv: "8a872f34889bcd9b7bce4530de7d4b7e"
server_key_version: "encryptionkey@0"
I20260619 04:39:34.203739 13891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:34.227205 13891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:34.232224 13891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:34.232565 13891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:34.233707 13891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:34.236004 13891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:34.236127 13891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:34.236310 13891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:34.236379 13891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:34.272436 13891 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:43583
I20260619 04:39:34.272480 14018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:43583 every 8 connection(s)
I20260619 04:39:34.273891 13891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:34.284097 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 13891
I20260619 04:39:34.284309 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:34.284849 10113 external_mini_cluster.cc:1428] Setting key 927cb5cc2cd84a056f61eac410450248
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:34.296448 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.276639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:52167 (local address 127.9.224.126:33479)
0619 04:39:34.276845 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:34.276849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:34.278193 (+ 1344us) server_negotiation.cc:407] Connection header received
0619 04:39:34.280088 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:34.280093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:34.280177 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:34.280293 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:34.281855 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.282731 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.284705 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.285200 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.285309 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.289825 (+ 4516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:34.289831 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:34.289834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:34.289870 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:34.292686 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.293864 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.293869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.293871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.294002 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.294520 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.294527 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.294534 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.294893 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:34.295046 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:34.295837 (+ 791us) server_negotiation.cc:299] Negotiation successful
0619 04:39:34.296072 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 04:39:34.297608 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.277213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:33479 (local address 127.9.224.66:52167)
0619 04:39:34.278001 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:34.278050 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:34.279785 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:34.280503 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:34.280512 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:34.281085 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:34.281648 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:34.281665 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.282874 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.282878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:34.284514 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:34.284530 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.285456 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.285463 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:34.285669 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.286436 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:34.286471 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:34.289529 (+ 3058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:34.292842 (+ 3313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:34.292855 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:34.292877 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:34.293579 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:34.294125 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:34.294132 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:34.294135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:34.294397 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:34.295017 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:34.295026 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:34.295446 (+ 420us) client_negotiation.cc:769] Sending connection context
0619 04:39:34.295715 (+ 269us) client_negotiation.cc:240] Negotiation successful
0619 04:39:34.296348 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":349,"threads_started":1}
I20260619 04:39:34.299309 14019 heartbeater.cc:347] Connected to a master server at 127.9.224.126:33479
I20260619 04:39:34.299624 14019 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:34.300381 14019 heartbeater.cc:511] Master 127.9.224.126:33479 requested a full tablet report, sending...
I20260619 04:39:34.301962 13696 ts_manager.cc:194] Registered new tserver with Master: ca6d50bab8b946b4b5814c11bae7719b (127.9.224.66:43583)
I20260619 04:39:34.302835 13696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:52167
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:34.333431 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:33479
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:34.669279 14024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:34.669559 14024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:34.669728 14024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:34.676975 14024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:34.677085 14024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:34.677282 14024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:34.687295 14024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:33479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:34.688768 14024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:34.690024 14024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:34.703174 14030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:34.703277 14032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:34.703217 14029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:34.704066 14024 server_base.cc:1034] running on GCE node
I20260619 04:39:34.704653 14024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:34.705641 14024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:34.706843 14024 hybrid_clock.cc:648] HybridClock initialized: now 1781843974706793 us; error 38 us; skew 500 ppm
I20260619 04:39:34.707196 14024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:34.710747 14024 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:34.712222 14024 webserver.cc:460] Webserver started at http://127.9.224.67:44961/ using document root <none> and password file <none>
I20260619 04:39:34.713012 14024 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:34.713125 14024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:34.713395 14024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:34.716434 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "66efd1de87284b6684217a12cefc8778"
format_stamp: "Formatted at 2026-06-19 04:39:34 on dist-test-slave-9dgf"
server_key: "3e56439319db2a218c7790251b0a4416"
server_key_iv: "6b3daf48440ec724c9a5487083fca579"
server_key_version: "encryptionkey@0"
I20260619 04:39:34.717201 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "66efd1de87284b6684217a12cefc8778"
format_stamp: "Formatted at 2026-06-19 04:39:34 on dist-test-slave-9dgf"
server_key: "3e56439319db2a218c7790251b0a4416"
server_key_iv: "6b3daf48440ec724c9a5487083fca579"
server_key_version: "encryptionkey@0"
I20260619 04:39:34.722652 14024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 04:39:34.726497 14039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:34.727944 14024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:34.728123 14024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "66efd1de87284b6684217a12cefc8778"
format_stamp: "Formatted at 2026-06-19 04:39:34 on dist-test-slave-9dgf"
server_key: "3e56439319db2a218c7790251b0a4416"
server_key_iv: "6b3daf48440ec724c9a5487083fca579"
server_key_version: "encryptionkey@0"
I20260619 04:39:34.728340 14024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:34.789348 14024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:34.793927 14024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:34.794183 14024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:34.795265 14024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:34.796828 14024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:34.796928 14024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:34.797061 14024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:34.797138 14024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:34.797190 13885 heartbeater.cc:503] Master 127.9.224.126:33479 was elected leader, sending a full tablet report...
I20260619 04:39:34.831766 14024 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:37757
I20260619 04:39:34.831856 14151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:37757 every 8 connection(s)
I20260619 04:39:34.833228 14024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:34.835443 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14024
I20260619 04:39:34.835642 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:34.836202 10113 external_mini_cluster.cc:1428] Setting key 147c69b933f1000ba65dba0f31206e3c
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:34.853633 14154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.835951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:50707 (local address 127.9.224.126:33479)
0619 04:39:34.836458 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:34.836462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:34.837618 (+ 1156us) server_negotiation.cc:407] Connection header received
0619 04:39:34.839513 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:34.839517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:34.839581 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:34.839675 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:34.841133 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.841878 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.843416 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.843806 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.843900 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.847398 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:34.847403 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:34.847407 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:34.847440 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:34.850536 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.851241 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.851246 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.851250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.851397 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.851833 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.851838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.851842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.852133 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:34.852295 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:34.853015 (+ 720us) server_negotiation.cc:299] Negotiation successful
0619 04:39:34.853245 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":341,"threads_started":1}
I20260619 04:39:34.854722 14155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.836641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:33479 (local address 127.9.224.67:50707)
0619 04:39:34.837466 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:34.837519 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:34.839273 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:34.839902 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:34.839910 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:34.840420 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:34.840981 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:34.840998 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.842013 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.842017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:34.843283 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:34.843294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.843987 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.843992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:34.844185 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.844828 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:34.844849 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:34.847152 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:34.850653 (+ 3501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:34.850660 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:34.850676 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:34.851106 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:34.851520 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:34.851526 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:34.851540 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:34.851716 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:34.852273 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:34.852281 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:34.852649 (+ 368us) client_negotiation.cc:769] Sending connection context
0619 04:39:34.852913 (+ 264us) client_negotiation.cc:240] Negotiation successful
0619 04:39:34.853464 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":329,"threads_started":1}
I20260619 04:39:34.856110 14152 heartbeater.cc:347] Connected to a master server at 127.9.224.126:33479
I20260619 04:39:34.856387 14152 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:34.857088 14152 heartbeater.cc:511] Master 127.9.224.126:33479 requested a full tablet report, sending...
I20260619 04:39:34.858521 13696 ts_manager.cc:194] Registered new tserver with Master: 66efd1de87284b6684217a12cefc8778 (127.9.224.67:37757)
I20260619 04:39:34.859278 13696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:50707
I20260619 04:39:34.863929 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:34.913311 14160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.897888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50816 (local address 127.9.224.65:42745)
0619 04:39:34.898572 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:34.898579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:34.898607 (+ 28us) server_negotiation.cc:407] Connection header received
0619 04:39:34.898789 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:34.898795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:34.899020 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:34.899153 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:34.900498 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.901477 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.902819 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.903442 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.903548 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.907599 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:34.907613 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:34.907629 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:34.907667 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:34.910810 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.911444 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.911451 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.911453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.911572 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.911913 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.911916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.911918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.912243 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:34.912512 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:34.912717 (+ 205us) server_negotiation.cc:299] Negotiation successful
0619 04:39:34.912913 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":405,"threads_started":1}
Jun 19 04:39:34 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:34.931203 14154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.917766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42346 (local address 127.9.224.126:33479)
0619 04:39:34.917989 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:34.917994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:34.918154 (+ 160us) server_negotiation.cc:407] Connection header received
0619 04:39:34.918305 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:34.918312 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:34.918387 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:34.918471 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:34.919683 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.920399 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.921606 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.922013 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.922112 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.925894 (+ 3782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:34.925900 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:34.925903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:34.925939 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:34.928693 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.929326 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.929336 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.929340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.929474 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.929802 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.929805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.929807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.930160 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:34.930459 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:34.930691 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 04:39:34.930867 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260619 04:39:34.931761 13696 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42346
I20260619 04:39:34.932952 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13757
I20260619 04:39:34.945785 14160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:34.933971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50832 (local address 127.9.224.65:42745)
0619 04:39:34.934178 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:34.934183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:34.934587 (+ 404us) server_negotiation.cc:407] Connection header received
0619 04:39:34.934702 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:34.934706 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:34.934802 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:34.934882 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:34.936001 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.936678 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.937853 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:34.938340 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:34.938439 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:34.940660 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:34.940666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:34.940669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:34.940705 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:34.943501 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.944138 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.944142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.944144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.944272 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:34.944585 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:34.944588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:34.944590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:34.944840 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:34.945018 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:34.945356 (+ 338us) server_negotiation.cc:299] Negotiation successful
0619 04:39:34.945523 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260619 04:39:34.946585 13880 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:35.031427 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13757
I20260619 04:39:35.047627 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13891
Jun 19 04:39:35 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:35.063278 14165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:35.048516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.9.224.66:43583)
0619 04:39:35.049139 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:35.049147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:35.049190 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:39:35.049253 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:35.049259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:35.049484 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:35.049627 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:35.051011 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:35.052009 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:35.053254 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:35.053790 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:35.053884 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:35.057925 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:35.057938 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:35.057953 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:35.057994 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:35.060737 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:35.061425 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:35.061433 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:35.061435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:35.061563 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:35.061881 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:35.061884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:35.061886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:35.062274 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:35.062517 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:35.062758 (+ 241us) server_negotiation.cc:299] Negotiation successful
0619 04:39:35.062960 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":359,"threads_started":1}
I20260619 04:39:35.064633 14014 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:35.147415 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13891
I20260619 04:39:35.164590 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14024
Jun 19 04:39:35 dist-test-slave-9dgf krb5kdc[13651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:35.180598 14167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:35.165606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52130 (local address 127.9.224.67:37757)
0619 04:39:35.166286 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:35.166298 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:35.166335 (+ 37us) server_negotiation.cc:407] Connection header received
0619 04:39:35.166396 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:35.166403 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:35.166621 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:35.166752 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:35.167907 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:35.168948 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:35.170316 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:35.170961 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:35.171072 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:35.175239 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:35.175252 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:35.175267 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:35.175302 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:35.178043 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:35.178808 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:35.178815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:35.178817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:35.178940 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:35.179260 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:35.179263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:35.179265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:35.179581 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:35.179844 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:35.180119 (+ 275us) server_negotiation.cc:299] Negotiation successful
0619 04:39:35.180318 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":308,"threads_started":1}
I20260619 04:39:35.181929 14147 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:35.268592 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14024
I20260619 04:39:35.284747 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 13664
I20260619 04:39:35.286059 13726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:35.388500 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 13664
2026-06-19T04:39:35Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3994 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:35 dist-test-slave-9dgf krb5kdc[14172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:35 dist-test-slave-9dgf krb5kdc[14172](info): set up 2 sockets
Jun 19 04:39:35 dist-test-slave-9dgf krb5kdc[14172](info): commencing operation
krb5kdc: starting...
W20260619 04:39:36.526674 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:36 dist-test-slave-9dgf krb5kdc[14172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:36.738940 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46633
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:37897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:37.073494 14185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:37.073804 14185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:37.073908 14185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:37.081869 14185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:37.082007 14185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:37.082056 14185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:37.082106 14185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:37.082156 14185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:37.092443 14185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:37897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:37.093760 14185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:37.095090 14185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:37.107138 14191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:37.107182 14190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:37.107092 14193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:37.108132 14185 server_base.cc:1034] running on GCE node
I20260619 04:39:37.108992 14185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:37.110559 14185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:37.111799 14185 hybrid_clock.cc:648] HybridClock initialized: now 1781843977111761 us; error 34 us; skew 500 ppm
I20260619 04:39:37.112175 14185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:37 dist-test-slave-9dgf krb5kdc[14172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843977, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:37.115513 14185 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:37.116811 14185 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:37.116950 14185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:37.117281 14185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:37.120496 14185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "aaa31c2644984dc6ae485c41fd9e09dc"
format_stamp: "Formatted at 2026-06-19 04:39:37 on dist-test-slave-9dgf"
server_key: "a6a532088b7cc26643686e54e34b38e2"
server_key_iv: "8a4251a80cfd30ae36c4916fed1d4cc7"
server_key_version: "encryptionkey@0"
I20260619 04:39:37.121402 14185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "aaa31c2644984dc6ae485c41fd9e09dc"
format_stamp: "Formatted at 2026-06-19 04:39:37 on dist-test-slave-9dgf"
server_key: "a6a532088b7cc26643686e54e34b38e2"
server_key_iv: "8a4251a80cfd30ae36c4916fed1d4cc7"
server_key_version: "encryptionkey@0"
I20260619 04:39:37.126967 14185 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 04:39:37.130815 14199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:37.132269 14185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:37.132472 14185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "aaa31c2644984dc6ae485c41fd9e09dc"
format_stamp: "Formatted at 2026-06-19 04:39:37 on dist-test-slave-9dgf"
server_key: "a6a532088b7cc26643686e54e34b38e2"
server_key_iv: "8a4251a80cfd30ae36c4916fed1d4cc7"
server_key_version: "encryptionkey@0"
I20260619 04:39:37.132717 14185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:37.152683 14185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:37.157688 14185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:37.158015 14185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:37.176954 14185 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:46633
I20260619 04:39:37.176980 14250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:46633 every 8 connection(s)
I20260619 04:39:37.178000 14185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:37.181157 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14185
I20260619 04:39:37.181391 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:37.182204 10113 external_mini_cluster.cc:1428] Setting key 8c8f1822a156e84c6942447ec96112c8
I20260619 04:39:37.182402 14251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:37.197644 14251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc: Bootstrap starting.
Jun 19 04:39:37 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:37.201247 14251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:37.202417 14251 log.cc:824] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:37.205395 14251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc: No bootstrap required, opened a new log
I20260619 04:39:37.206651 14254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:37.184393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34206 (local address 127.9.224.126:46633)
0619 04:39:37.185249 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:37.185261 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:37.185306 (+ 45us) server_negotiation.cc:407] Connection header received
0619 04:39:37.187310 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:37.187337 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:37.187851 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:37.188249 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:37.190115 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:37.191529 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:37.193336 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:37.194113 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:37.194320 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:37.199153 (+ 4833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:37.199164 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:37.199179 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:37.199237 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:37.202436 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:37.203139 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:37.203145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:37.203151 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:37.203317 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:37.203716 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:37.203722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:37.203737 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:37.204342 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:37.204644 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:37.205075 (+ 431us) server_negotiation.cc:299] Negotiation successful
0619 04:39:37.205563 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":407,"threads_started":1}
I20260619 04:39:37.213853 14251 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46633 } }
I20260619 04:39:37.214303 14251 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:37.214425 14251 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaa31c2644984dc6ae485c41fd9e09dc, State: Initialized, Role: FOLLOWER
I20260619 04:39:37.215088 14251 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46633 } }
I20260619 04:39:37.215327 14251 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:37.215479 14251 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:37.215647 14251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:37.218391 14251 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46633 } }
I20260619 04:39:37.218947 14251 leader_election.cc:302] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaa31c2644984dc6ae485c41fd9e09dc; no voters:
I20260619 04:39:37.219663 14251 leader_election.cc:288] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:37.219813 14256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:37.220511 14256 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [term 1 LEADER]: Becoming Leader. State: Replica: aaa31c2644984dc6ae485c41fd9e09dc, State: Running, Role: LEADER
I20260619 04:39:37.221143 14256 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46633 } }
I20260619 04:39:37.222086 14251 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:37.224383 14258 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaa31c2644984dc6ae485c41fd9e09dc. Latest consensus state: current_term: 1 leader_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46633 } } }
I20260619 04:39:37.224857 14258 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:37.225359 14257 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa31c2644984dc6ae485c41fd9e09dc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46633 } } }
I20260619 04:39:37.225711 14257 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:37.227461 14264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:37.232916 14264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:37.242318 14264 catalog_manager.cc:1347] Generated new cluster ID: 2c7869588d2d43ba970ca25d3004536f
I20260619 04:39:37.242460 14264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:37.254861 14264 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:37.256863 14264 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:37.267243 14264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc: Generated new TSK 0
I20260619 04:39:37.268432 14264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:37.328366 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46633
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:37897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:37.658169 14277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:37.658560 14277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:37.658737 14277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:37.666122 14277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:37.666321 14277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:37.666502 14277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:37.676373 14277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:37897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46633
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:37.678079 14277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:37.679440 14277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:37.692449 14282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:37.692502 14285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:37.692471 14283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:37.693696 14277 server_base.cc:1034] running on GCE node
I20260619 04:39:37.694295 14277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:37.695227 14277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:37.696498 14277 hybrid_clock.cc:648] HybridClock initialized: now 1781843977696407 us; error 81 us; skew 500 ppm
I20260619 04:39:37.696826 14277 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:37 dist-test-slave-9dgf krb5kdc[14172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843977, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:37.700006 14277 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:37.701195 14277 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:37.701326 14277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:37.701669 14277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:37.704742 14277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "f77b16eba56c49818b0bf9b6f68b97dd"
format_stamp: "Formatted at 2026-06-19 04:39:37 on dist-test-slave-9dgf"
server_key: "e2106aef1ee4eb0286119736dfae236c"
server_key_iv: "a0e66108dee0b85d898771b58108cada"
server_key_version: "encryptionkey@0"
I20260619 04:39:37.705804 14277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "f77b16eba56c49818b0bf9b6f68b97dd"
format_stamp: "Formatted at 2026-06-19 04:39:37 on dist-test-slave-9dgf"
server_key: "e2106aef1ee4eb0286119736dfae236c"
server_key_iv: "a0e66108dee0b85d898771b58108cada"
server_key_version: "encryptionkey@0"
I20260619 04:39:37.711172 14277 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260619 04:39:37.714748 14291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:37.716197 14277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:37.716392 14277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "f77b16eba56c49818b0bf9b6f68b97dd"
format_stamp: "Formatted at 2026-06-19 04:39:37 on dist-test-slave-9dgf"
server_key: "e2106aef1ee4eb0286119736dfae236c"
server_key_iv: "a0e66108dee0b85d898771b58108cada"
server_key_version: "encryptionkey@0"
I20260619 04:39:37.716629 14277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:37.742574 14277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:37.746984 14277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:37.747299 14277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:37.748335 14277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:37.749804 14277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:37.749938 14277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:37.750061 14277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:37.750147 14277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:37.787429 14277 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:45643
I20260619 04:39:37.787516 14403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:45643 every 8 connection(s)
I20260619 04:39:37.788291 14277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:37.790491 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14277
I20260619 04:39:37.790719 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:37.791543 10113 external_mini_cluster.cc:1428] Setting key c83a40c534cec128ac3bbd1cf5840946
Jun 19 04:39:37 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843977, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:37.812805 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:37.791044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:38229 (local address 127.9.224.126:46633)
0619 04:39:37.791536 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:37.791543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:37.792659 (+ 1116us) server_negotiation.cc:407] Connection header received
0619 04:39:37.795198 (+ 2539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:37.795203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:37.795273 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:37.795361 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:37.797556 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:37.798341 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:37.800678 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:37.801428 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:37.801570 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:37.805178 (+ 3608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:37.805188 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:37.805196 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:37.805244 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:37.809023 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:37.810016 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:37.810024 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:37.810032 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:37.810209 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:37.810700 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:37.810706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:37.810712 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:37.811080 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:37.811237 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:37.812073 (+ 836us) server_negotiation.cc:299] Negotiation successful
0619 04:39:37.812334 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":239,"threads_started":1}
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:37.813695 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:37.791673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46633 (local address 127.9.224.65:38229)
0619 04:39:37.792480 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:37.792532 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:37.794886 (+ 2354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:37.795655 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:37.795669 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:37.796490 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:37.797350 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:37.797381 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:37.798490 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:37.798499 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:37.800517 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:37.800529 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:37.801647 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:37.801652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:37.801863 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:37.802612 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:37.802642 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:37.804923 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:37.809192 (+ 4269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:37.809199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:37.809215 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:37.809865 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:37.810389 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:37.810392 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:37.810395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:37.810581 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:37.811275 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:37.811282 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:37.811660 (+ 378us) client_negotiation.cc:769] Sending connection context
0619 04:39:37.811930 (+ 270us) client_negotiation.cc:240] Negotiation successful
0619 04:39:37.812416 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":307,"threads_started":1}
I20260619 04:39:37.815570 14404 heartbeater.cc:347] Connected to a master server at 127.9.224.126:46633
I20260619 04:39:37.815840 14404 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:39:37.816658 14404 heartbeater.cc:511] Master 127.9.224.126:46633 requested a full tablet report, sending...
I20260619 04:39:37.818882 14216 ts_manager.cc:194] Registered new tserver with Master: f77b16eba56c49818b0bf9b6f68b97dd (127.9.224.65:45643)
I20260619 04:39:37.820412 14216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:38229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:37.841579 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46633
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:37897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:38.168378 14410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:38.168668 14410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:38.168771 14410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:38.176115 14410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:38.176239 14410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:38.176429 14410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:38.186447 14410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:37897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46633
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:38.187708 14410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:38.188974 14410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:38.202168 14416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:38.202124 14415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:38.202204 14418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:38.203179 14410 server_base.cc:1034] running on GCE node
I20260619 04:39:38.203789 14410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:38.204736 14410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:38.205940 14410 hybrid_clock.cc:648] HybridClock initialized: now 1781843978205898 us; error 33 us; skew 500 ppm
I20260619 04:39:38.206385 14410 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:38 dist-test-slave-9dgf krb5kdc[14172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843978, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:38.213001 14410 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:38.214455 14410 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:38.214598 14410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:38.214912 14410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:38.217849 14410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "280a7926a67b4abda727ad96c3839222"
format_stamp: "Formatted at 2026-06-19 04:39:38 on dist-test-slave-9dgf"
server_key: "cfb14fba7d7a629dcc40b5edc79a3bc4"
server_key_iv: "26102af628a86dbc0fea8432309a2607"
server_key_version: "encryptionkey@0"
I20260619 04:39:38.218694 14410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "280a7926a67b4abda727ad96c3839222"
format_stamp: "Formatted at 2026-06-19 04:39:38 on dist-test-slave-9dgf"
server_key: "cfb14fba7d7a629dcc40b5edc79a3bc4"
server_key_iv: "26102af628a86dbc0fea8432309a2607"
server_key_version: "encryptionkey@0"
I20260619 04:39:38.224018 14410 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:39:38.227648 14424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:38.229043 14410 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:38.229219 14410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "280a7926a67b4abda727ad96c3839222"
format_stamp: "Formatted at 2026-06-19 04:39:38 on dist-test-slave-9dgf"
server_key: "cfb14fba7d7a629dcc40b5edc79a3bc4"
server_key_iv: "26102af628a86dbc0fea8432309a2607"
server_key_version: "encryptionkey@0"
I20260619 04:39:38.229472 14410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:38.253865 14410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:38.258224 14410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:38.258564 14410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:38.259611 14410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:38.260982 14410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:38.261112 14410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:38.261250 14410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:38.261337 14410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:38.296119 14410 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:44985
I20260619 04:39:38.296206 14536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:44985 every 8 connection(s)
I20260619 04:39:38.297006 14410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:38.302354 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14410
I20260619 04:39:38.302554 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:38.303113 10113 external_mini_cluster.cc:1428] Setting key e59b6590575048b7e66a9fc7edb011ee
Jun 19 04:39:38 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843978, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:38.319885 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.299520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:36653 (local address 127.9.224.126:46633)
0619 04:39:38.299728 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:38.299736 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:38.300974 (+ 1238us) server_negotiation.cc:407] Connection header received
0619 04:39:38.303267 (+ 2293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:38.303276 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:38.303410 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:38.303519 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:38.305398 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.306489 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.308104 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.308854 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.308994 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.312685 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:38.312694 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:38.312702 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:38.312748 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:38.316473 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:38.317233 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:38.317240 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:38.317247 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:38.317411 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:38.317821 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:38.317828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:38.317835 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:38.318251 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:38.318405 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:38.319153 (+ 748us) server_negotiation.cc:299] Negotiation successful
0619 04:39:38.319419 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:39:38.320891 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.300100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46633 (local address 127.9.224.66:36653)
0619 04:39:38.300803 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:38.300841 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:38.302881 (+ 2040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:38.303848 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:38.303864 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:38.304466 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:38.305189 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.305224 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.306632 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.306635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.307955 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.307968 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.309069 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.309074 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.309267 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.310008 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:38.310030 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:38.312457 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:38.316641 (+ 4184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:38.316648 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:38.316662 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:38.317107 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:38.317522 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:38.317525 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:38.317527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:38.317706 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:38.318402 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:38.318409 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:38.318769 (+ 360us) client_negotiation.cc:769] Sending connection context
0619 04:39:38.319024 (+ 255us) client_negotiation.cc:240] Negotiation successful
0619 04:39:38.319471 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":302,"threads_started":1}
I20260619 04:39:38.322793 14537 heartbeater.cc:347] Connected to a master server at 127.9.224.126:46633
I20260619 04:39:38.323163 14537 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:38.323922 14537 heartbeater.cc:511] Master 127.9.224.126:46633 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
I20260619 04:39:38.325568 14216 ts_manager.cc:194] Registered new tserver with Master: 280a7926a67b4abda727ad96c3839222 (127.9.224.66:44985)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
I20260619 04:39:38.326781 14216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:36653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:38.353474 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46633
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:37897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:38.677590 14542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:38.677933 14542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:38.678100 14542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:38.685649 14542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:38.685811 14542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:38.686019 14542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:38.696125 14542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:37897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46633
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:38.697507 14542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:38.698967 14542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:38.712333 14550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:38.712435 14547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:38.712405 14548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:38.713825 14542 server_base.cc:1034] running on GCE node
I20260619 04:39:38.714692 14542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:38.715695 14542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:38.716975 14542 hybrid_clock.cc:648] HybridClock initialized: now 1781843978716913 us; error 70 us; skew 500 ppm
I20260619 04:39:38.717376 14542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:38 dist-test-slave-9dgf krb5kdc[14172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843978, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:38.720989 14542 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:38.722468 14542 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:38.722566 14542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:38.722844 14542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:38.725991 14542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "dc8a5a3e91f447d09994a0e358d19cff"
format_stamp: "Formatted at 2026-06-19 04:39:38 on dist-test-slave-9dgf"
server_key: "b26a263a96eca61a5f3651c02c927040"
server_key_iv: "f18e07bd83db495ba6ab3958254eca2e"
server_key_version: "encryptionkey@0"
I20260619 04:39:38.727290 14542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "dc8a5a3e91f447d09994a0e358d19cff"
format_stamp: "Formatted at 2026-06-19 04:39:38 on dist-test-slave-9dgf"
server_key: "b26a263a96eca61a5f3651c02c927040"
server_key_iv: "f18e07bd83db495ba6ab3958254eca2e"
server_key_version: "encryptionkey@0"
I20260619 04:39:38.733574 14542 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260619 04:39:38.737892 14556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:38.739838 14542 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260619 04:39:38.740023 14542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "dc8a5a3e91f447d09994a0e358d19cff"
format_stamp: "Formatted at 2026-06-19 04:39:38 on dist-test-slave-9dgf"
server_key: "b26a263a96eca61a5f3651c02c927040"
server_key_iv: "f18e07bd83db495ba6ab3958254eca2e"
server_key_version: "encryptionkey@0"
I20260619 04:39:38.740298 14542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:38.755438 14542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:38.759799 14542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:38.760135 14542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:38.761458 14542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:38.762921 14542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:38.763041 14542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:38.763149 14542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:38.763247 14542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:38.797329 14542 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:40659
I20260619 04:39:38.797386 14668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:40659 every 8 connection(s)
I20260619 04:39:38.798161 14542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:38.802917 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14542
I20260619 04:39:38.803117 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:38.803699 10113 external_mini_cluster.cc:1428] Setting key 98400c10bcc68c30751c7bea06b85a6a
Jun 19 04:39:38 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843978, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:38.818843 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.800586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:37915 (local address 127.9.224.126:46633)
0619 04:39:38.800809 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:38.800814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:38.802031 (+ 1217us) server_negotiation.cc:407] Connection header received
0619 04:39:38.804568 (+ 2537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:38.804573 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:38.804669 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:38.804786 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:38.806536 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.807433 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.809125 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.809581 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.809722 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.813094 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:38.813100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:38.813103 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:38.813136 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:38.815549 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:38.816235 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:38.816238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:38.816241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:38.816363 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:38.816753 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:38.816757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:38.816759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:38.817126 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:38.817283 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:38.818264 (+ 981us) server_negotiation.cc:299] Negotiation successful
0619 04:39:38.818489 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:39:38.819970 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.801091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46633 (local address 127.9.224.67:37915)
0619 04:39:38.801772 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:38.801815 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:38.804292 (+ 2477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:38.805019 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:38.805051 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:38.805714 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:38.806361 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.806379 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.807717 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.807729 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.808976 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.808988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.809817 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.809825 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.810065 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.810747 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:38.810775 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:38.812896 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:38.815674 (+ 2778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:38.815680 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:38.815693 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:38.816128 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:38.816451 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:38.816453 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:38.816456 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:38.816616 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:38.817288 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:38.817295 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:38.817760 (+ 465us) client_negotiation.cc:769] Sending connection context
0619 04:39:38.818105 (+ 345us) client_negotiation.cc:240] Negotiation successful
0619 04:39:38.818721 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":271,"threads_started":1}
I20260619 04:39:38.821382 14669 heartbeater.cc:347] Connected to a master server at 127.9.224.126:46633
I20260619 04:39:38.821750 14669 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:38.822487 14669 heartbeater.cc:511] Master 127.9.224.126:46633 requested a full tablet report, sending...
I20260619 04:39:38.823882 14216 ts_manager.cc:194] Registered new tserver with Master: dc8a5a3e91f447d09994a0e358d19cff (127.9.224.67:40659)
I20260619 04:39:38.824234 14404 heartbeater.cc:503] Master 127.9.224.126:46633 was elected leader, sending a full tablet report...
I20260619 04:39:38.824832 14216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:37915
I20260619 04:39:38.831691 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:39:38.849501 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.836318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34208 (local address 127.9.224.126:46633)
0619 04:39:38.836520 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:38.836525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:38.837087 (+ 562us) server_negotiation.cc:407] Connection header received
0619 04:39:38.837230 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:38.837234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:38.837296 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:38.837379 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:38.838927 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.839625 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.840882 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.841312 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.841408 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.843877 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:38.843882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:38.843885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:38.843918 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:38.846694 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:38.847470 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:38.847474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:38.847477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:38.847605 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:38.847932 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:38.847935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:38.847937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:38.848242 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:38.848431 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:38.848980 (+ 549us) server_negotiation.cc:299] Negotiation successful
0619 04:39:38.849205 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:39:38.853667 14215 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:38.860656 14215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:38.883466 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.872839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39894 (local address 127.9.224.66:44985)
0619 04:39:38.873448 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:38.873459 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:38.874330 (+ 871us) server_negotiation.cc:407] Connection header received
0619 04:39:38.874771 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:38.874780 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:38.875073 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:38.875246 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:38.876365 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.877996 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.880267 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.881746 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.881902 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.882112 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:38.882911 (+ 799us) server_negotiation.cc:299] Negotiation successful
0619 04:39:38.883133 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":287,"threads_started":1}
I20260619 04:39:38.883489 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.872724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:44985 (local address 127.0.0.1:39894)
0619 04:39:38.874080 (+ 1356us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:38.874128 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:38.874500 (+ 372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:38.875605 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:38.875615 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:38.875655 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:38.876105 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.876117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.878155 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.878160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.880107 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.880119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.882283 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.882290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.882609 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.882671 (+ 62us) client_negotiation.cc:769] Sending connection context
0619 04:39:38.882835 (+ 164us) client_negotiation.cc:240] Negotiation successful
0619 04:39:38.883041 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"mutex_wait_us":81,"thread_start_us":4055,"threads_started":1}
I20260619 04:39:38.885625 14685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.872774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45643 (local address 127.0.0.1:50642)
0619 04:39:38.876740 (+ 3966us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:38.876764 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:38.876984 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:38.877888 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:38.877892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:38.877912 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:38.878679 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.878694 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.880629 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.880634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.883091 (+ 2457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.883103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.884878 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.884882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.884994 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.885015 (+ 21us) client_negotiation.cc:769] Sending connection context
0619 04:39:38.885112 (+ 97us) client_negotiation.cc:240] Negotiation successful
0619 04:39:38.885238 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3824,"mutex_wait_us":152,"thread_start_us":876,"threads_started":1}
I20260619 04:39:38.885655 14684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.873383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50642 (local address 127.9.224.65:45643)
0619 04:39:38.876277 (+ 2894us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:38.876288 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:38.876876 (+ 588us) server_negotiation.cc:407] Connection header received
0619 04:39:38.877240 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:38.877250 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:38.877479 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:38.877651 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:38.878842 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.880480 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.883289 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.884494 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.884578 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.884740 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:38.885172 (+ 432us) server_negotiation.cc:299] Negotiation successful
0619 04:39:38.885331 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2703,"thread_start_us":2562,"threads_started":1}
I20260619 04:39:38.887495 14681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.874170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:40659 (local address 127.0.0.1:50504)
0619 04:39:38.877052 (+ 2882us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:38.877068 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:38.877173 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:38.877971 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:38.877975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:38.878002 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:38.878742 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.878757 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.880688 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.880693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.882942 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:38.882959 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.886670 (+ 3711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.886677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:38.886860 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.886890 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 04:39:38.886977 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 04:39:38.887109 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2758,"mutex_wait_us":159,"thread_start_us":2302,"threads_started":1}
I20260619 04:39:38.887651 14686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:38.874382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.9.224.67:40659)
0619 04:39:38.875746 (+ 1364us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:38.875758 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:38.877161 (+ 1403us) server_negotiation.cc:407] Connection header received
0619 04:39:38.877331 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:38.877339 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:38.877555 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:38.877728 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:38.878987 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.880528 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.883142 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:38.886108 (+ 2966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:38.886210 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:38.886477 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:38.887122 (+ 645us) server_negotiation.cc:299] Negotiation successful
0619 04:39:38.887310 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1161,"thread_start_us":991,"threads_started":1}
I20260619 04:39:38.887970 14472 tablet_service.cc:1467] Processing CreateTablet for tablet 8a5e2d9f30cf418c97979294c7951b49 (DEFAULT_TABLE table=test-table [id=eb7afa3d03bb49d1bca5f35f98f168f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:38.889564 14472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a5e2d9f30cf418c97979294c7951b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:38.889328 14339 tablet_service.cc:1467] Processing CreateTablet for tablet 8a5e2d9f30cf418c97979294c7951b49 (DEFAULT_TABLE table=test-table [id=eb7afa3d03bb49d1bca5f35f98f168f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:38.890690 14339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a5e2d9f30cf418c97979294c7951b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:38.891750 14604 tablet_service.cc:1467] Processing CreateTablet for tablet 8a5e2d9f30cf418c97979294c7951b49 (DEFAULT_TABLE table=test-table [id=eb7afa3d03bb49d1bca5f35f98f168f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:38.893107 14604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a5e2d9f30cf418c97979294c7951b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:38.903545 14687 tablet_bootstrap.cc:492] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Bootstrap starting.
I20260619 04:39:38.904793 14688 tablet_bootstrap.cc:492] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Bootstrap starting.
I20260619 04:39:38.907711 14689 tablet_bootstrap.cc:492] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Bootstrap starting.
I20260619 04:39:38.907819 14687 tablet_bootstrap.cc:654] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:38.908622 14688 tablet_bootstrap.cc:654] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:38.909183 14687 log.cc:824] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:38.909955 14688 log.cc:824] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:38.911425 14689 tablet_bootstrap.cc:654] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:38.912806 14689 log.cc:824] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:38.914114 14688 tablet_bootstrap.cc:492] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: No bootstrap required, opened a new log
I20260619 04:39:38.914171 14687 tablet_bootstrap.cc:492] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: No bootstrap required, opened a new log
I20260619 04:39:38.914458 14687 ts_tablet_manager.cc:1397] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260619 04:39:38.914474 14688 ts_tablet_manager.cc:1397] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260619 04:39:38.916221 14689 tablet_bootstrap.cc:492] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: No bootstrap required, opened a new log
I20260619 04:39:38.916494 14689 ts_tablet_manager.cc:1397] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 04:39:38.922582 14687 raft_consensus.cc:348] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:38.923069 14687 raft_consensus.cc:374] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:38.923178 14687 raft_consensus.cc:729] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77b16eba56c49818b0bf9b6f68b97dd, State: Initialized, Role: FOLLOWER
I20260619 04:39:38.923846 14687 consensus_queue.cc:260] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:38.925103 14688 raft_consensus.cc:348] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:38.925557 14688 raft_consensus.cc:374] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:38.925647 14688 raft_consensus.cc:729] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280a7926a67b4abda727ad96c3839222, State: Initialized, Role: FOLLOWER
I20260619 04:39:38.925678 14687 ts_tablet_manager.cc:1428] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260619 04:39:38.926419 14688 consensus_queue.cc:260] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:38.927346 14689 raft_consensus.cc:348] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:38.927663 14537 heartbeater.cc:503] Master 127.9.224.126:46633 was elected leader, sending a full tablet report...
I20260619 04:39:38.927752 14689 raft_consensus.cc:374] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:38.927865 14689 raft_consensus.cc:729] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc8a5a3e91f447d09994a0e358d19cff, State: Initialized, Role: FOLLOWER
I20260619 04:39:38.928459 14689 consensus_queue.cc:260] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:38.928419 14688 ts_tablet_manager.cc:1428] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260619 04:39:38.933028 14669 heartbeater.cc:503] Master 127.9.224.126:46633 was elected leader, sending a full tablet report...
I20260619 04:39:38.933542 14689 ts_tablet_manager.cc:1428] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Time spent starting tablet: real 0.017s user 0.013s sys 0.005s
W20260619 04:39:39.040601 14405 tablet.cc:2369] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:39:39.048957 14538 tablet.cc:2369] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:39:39.049906 14670 tablet.cc:2369] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:39.098735 14695 raft_consensus.cc:482] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:39.099180 14695 raft_consensus.cc:504] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:39.101028 14695 leader_election.cc:288] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 280a7926a67b4abda727ad96c3839222 (127.9.224.66:44985), f77b16eba56c49818b0bf9b6f68b97dd (127.9.224.65:45643)
I20260619 04:39:39.107699 14684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.101577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:50711 (local address 127.9.224.65:45643)
0619 04:39:39.101807 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:39.101815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:39.102134 (+ 319us) server_negotiation.cc:407] Connection header received
0619 04:39:39.102427 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:39.102431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:39.102501 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:39.102609 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:39.103028 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.103789 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.105840 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.106663 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.106856 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.106950 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:39.107267 (+ 317us) server_negotiation.cc:299] Negotiation successful
0619 04:39:39.107427 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 04:39:39.107707 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.101561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:55663 (local address 127.9.224.66:44985)
0619 04:39:39.101807 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:39.101815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:39.102374 (+ 559us) server_negotiation.cc:407] Connection header received
0619 04:39:39.102572 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:39.102577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:39.102635 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:39.102738 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:39.103304 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.103996 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.105779 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.106740 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.106893 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.106971 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:39.107310 (+ 339us) server_negotiation.cc:299] Negotiation successful
0619 04:39:39.107434 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260619 04:39:39.107757 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.101510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45643 (local address 127.9.224.67:50711)
0619 04:39:39.101993 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:39.102013 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:39.102213 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:39.102638 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:39.102643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:39.102671 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:39.102879 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:39.102888 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.103933 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.103941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:39.105682 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:39.105695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.106832 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.106839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:39.107062 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.107107 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 04:39:39.107244 (+ 137us) client_negotiation.cc:240] Negotiation successful
0619 04:39:39.107420 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":26}
I20260619 04:39:39.107857 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.101545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:44985 (local address 127.9.224.67:55663)
0619 04:39:39.102211 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:39.102273 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:39.102429 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:39.102756 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:39.102760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:39.102784 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:39.103155 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:39.103163 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.104149 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.104157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:39.105629 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:39.105641 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.106944 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.106950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:39.107144 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.107167 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 04:39:39.107268 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 04:39:39.107393 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":92,"thread_start_us":354,"threads_started":1}
I20260619 04:39:39.109074 14492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5e2d9f30cf418c97979294c7951b49" candidate_uuid: "dc8a5a3e91f447d09994a0e358d19cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280a7926a67b4abda727ad96c3839222" is_pre_election: true
I20260619 04:39:39.109079 14359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5e2d9f30cf418c97979294c7951b49" candidate_uuid: "dc8a5a3e91f447d09994a0e358d19cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" is_pre_election: true
I20260619 04:39:39.109598 14492 raft_consensus.cc:2454] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc8a5a3e91f447d09994a0e358d19cff in term 0.
I20260619 04:39:39.109624 14359 raft_consensus.cc:2454] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc8a5a3e91f447d09994a0e358d19cff in term 0.
I20260619 04:39:39.110327 14559 leader_election.cc:302] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280a7926a67b4abda727ad96c3839222, dc8a5a3e91f447d09994a0e358d19cff; no voters:
I20260619 04:39:39.110766 14695 raft_consensus.cc:2781] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:39.110924 14695 raft_consensus.cc:482] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:39.111053 14695 raft_consensus.cc:3037] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:39.113397 14695 raft_consensus.cc:504] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:39.114197 14695 leader_election.cc:288] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [CANDIDATE]: Term 1 election: Requested vote from peers 280a7926a67b4abda727ad96c3839222 (127.9.224.66:44985), f77b16eba56c49818b0bf9b6f68b97dd (127.9.224.65:45643)
I20260619 04:39:39.114650 14492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5e2d9f30cf418c97979294c7951b49" candidate_uuid: "dc8a5a3e91f447d09994a0e358d19cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280a7926a67b4abda727ad96c3839222"
I20260619 04:39:39.114693 14359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5e2d9f30cf418c97979294c7951b49" candidate_uuid: "dc8a5a3e91f447d09994a0e358d19cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77b16eba56c49818b0bf9b6f68b97dd"
I20260619 04:39:39.114892 14492 raft_consensus.cc:3037] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:39.114907 14359 raft_consensus.cc:3037] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:39.117096 14359 raft_consensus.cc:2454] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc8a5a3e91f447d09994a0e358d19cff in term 1.
I20260619 04:39:39.117228 14492 raft_consensus.cc:2454] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc8a5a3e91f447d09994a0e358d19cff in term 1.
I20260619 04:39:39.117591 14560 leader_election.cc:302] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc8a5a3e91f447d09994a0e358d19cff, f77b16eba56c49818b0bf9b6f68b97dd; no voters:
I20260619 04:39:39.117935 14695 raft_consensus.cc:2781] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:39.118630 14695 raft_consensus.cc:686] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 1 LEADER]: Becoming Leader. State: Replica: dc8a5a3e91f447d09994a0e358d19cff, State: Running, Role: LEADER
I20260619 04:39:39.119601 14695 consensus_queue.cc:237] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } }
I20260619 04:39:39.124814 14214 catalog_manager.cc:5495] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff reported cstate change: term changed from 0 to 1, leader changed from <none> to dc8a5a3e91f447d09994a0e358d19cff (127.9.224.67). New cstate: current_term: 1 leader_uuid: "dc8a5a3e91f447d09994a0e358d19cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc8a5a3e91f447d09994a0e358d19cff" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40659 } health_report { overall_health: HEALTHY } } }
I20260619 04:39:39.188730 14686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.183449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50518 (local address 127.9.224.67:40659)
0619 04:39:39.183661 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:39.183667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:39.183685 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:39:39.183875 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:39.183879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:39.183955 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:39.184102 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:39.184452 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.185181 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.186580 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.186992 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.187127 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.187624 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:39.188134 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:39.188320 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:39.188381 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 04:39:39.188463 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:39:39.197225 14359 raft_consensus.cc:1261] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 1 FOLLOWER]: Refusing update from remote peer dc8a5a3e91f447d09994a0e358d19cff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:39.197221 14492 raft_consensus.cc:1261] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 1 FOLLOWER]: Refusing update from remote peer dc8a5a3e91f447d09994a0e358d19cff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:39.198415 14697 consensus_queue.cc:1035] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f77b16eba56c49818b0bf9b6f68b97dd" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:39.198799 14695 consensus_queue.cc:1035] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "280a7926a67b4abda727ad96c3839222" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 44985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:39.211596 14700 mvcc.cc:205] Tried to move back new op lower bound from 7298432938781704192 to 7298432938478985216. Current Snapshot: MvccSnapshot[applied={T|T < 7298432938781704192}]
I20260619 04:39:39.225608 14214 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:39.225942 14214 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:39.229928 14214 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aaa31c2644984dc6ae485c41fd9e09dc: Sending DeleteTablet for 3 replicas of tablet 8a5e2d9f30cf418c97979294c7951b49
I20260619 04:39:39.231225 14472 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a5e2d9f30cf418c97979294c7951b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:39 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:39894
I20260619 04:39:39.231659 14604 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a5e2d9f30cf418c97979294c7951b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:39 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:50504
I20260619 04:39:39.231964 14339 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a5e2d9f30cf418c97979294c7951b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:39 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:50642
I20260619 04:39:39.232579 14711 tablet_replica.cc:330] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: stopping tablet replica
I20260619 04:39:39.233100 14711 raft_consensus.cc:2229] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:39.233811 14710 tablet_replica.cc:330] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: stopping tablet replica
I20260619 04:39:39.233903 14711 raft_consensus.cc:2258] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:39.234663 14710 raft_consensus.cc:2229] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:39.235262 14710 raft_consensus.cc:2258] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:39.236245 14711 ts_tablet_manager.cc:1905] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:39.237993 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14277
I20260619 04:39:39.237821 14710 ts_tablet_manager.cc:1905] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:39.243916 14711 ts_tablet_manager.cc:1918] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:39.244128 14711 log.cc:1196] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/8a5e2d9f30cf418c97979294c7951b49
I20260619 04:39:39.244787 14711 ts_tablet_manager.cc:1939] T 8a5e2d9f30cf418c97979294c7951b49 P dc8a5a3e91f447d09994a0e358d19cff: Deleting consensus metadata
I20260619 04:39:39.246758 14201 catalog_manager.cc:4841] TS dc8a5a3e91f447d09994a0e358d19cff (127.9.224.67:40659): tablet 8a5e2d9f30cf418c97979294c7951b49 (table test-table [id=eb7afa3d03bb49d1bca5f35f98f168f4]) successfully deleted
I20260619 04:39:39.250607 14710 ts_tablet_manager.cc:1918] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:39.250816 14710 log.cc:1196] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/8a5e2d9f30cf418c97979294c7951b49
I20260619 04:39:39.251217 14712 tablet_replica.cc:330] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: stopping tablet replica
I20260619 04:39:39.251392 14710 ts_tablet_manager.cc:1939] T 8a5e2d9f30cf418c97979294c7951b49 P 280a7926a67b4abda727ad96c3839222: Deleting consensus metadata
I20260619 04:39:39.251817 14712 raft_consensus.cc:2229] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:39.252467 14712 raft_consensus.cc:2258] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:39.253382 14202 catalog_manager.cc:4841] TS 280a7926a67b4abda727ad96c3839222 (127.9.224.66:44985): tablet 8a5e2d9f30cf418c97979294c7951b49 (table test-table [id=eb7afa3d03bb49d1bca5f35f98f168f4]) successfully deleted
I20260619 04:39:39.255228 14712 ts_tablet_manager.cc:1905] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 04:39:39 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:39.261307 14712 ts_tablet_manager.cc:1918] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:39.261512 14712 log.cc:1196] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/8a5e2d9f30cf418c97979294c7951b49
I20260619 04:39:39.261973 14712 ts_tablet_manager.cc:1939] T 8a5e2d9f30cf418c97979294c7951b49 P f77b16eba56c49818b0bf9b6f68b97dd: Deleting consensus metadata
I20260619 04:39:39.263983 14203 catalog_manager.cc:4841] TS f77b16eba56c49818b0bf9b6f68b97dd (127.9.224.65:45643): tablet 8a5e2d9f30cf418c97979294c7951b49 (table test-table [id=eb7afa3d03bb49d1bca5f35f98f168f4]) successfully deleted
I20260619 04:39:39.265575 14684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.239698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50654 (local address 127.9.224.65:45643)
0619 04:39:39.239875 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:39.239882 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:39.245483 (+ 5601us) server_negotiation.cc:407] Connection header received
0619 04:39:39.245768 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:39.245777 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:39.245908 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:39.246022 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:39.248373 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.249592 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.251514 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.252291 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.252395 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.257869 (+ 5474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:39.257886 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:39.257905 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:39.257955 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:39.262068 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:39.263063 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:39.263075 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:39.263079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:39.263280 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:39.263756 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:39.263762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:39.263765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:39.264169 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:39.264424 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:39.264947 (+ 523us) server_negotiation.cc:299] Negotiation successful
0619 04:39:39.265192 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:39:39.266407 14399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:39.356153 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14277
I20260619 04:39:39.373129 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14410
Jun 19 04:39:39 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:39.390519 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.373986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.9.224.66:44985)
0619 04:39:39.374211 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:39.374217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:39.374262 (+ 45us) server_negotiation.cc:407] Connection header received
0619 04:39:39.374409 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:39.374415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:39.374520 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:39.374631 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:39.375833 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.376989 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.378380 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.379029 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.379169 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.383327 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:39.383349 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:39.383371 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:39.383431 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:39.387456 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:39.388255 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:39.388265 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:39.388269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:39.388451 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:39.388836 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:39.388841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:39.388845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:39.389358 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:39.389675 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:39.389860 (+ 185us) server_negotiation.cc:299] Negotiation successful
0619 04:39:39.390086 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:39.391213 14532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:39.481401 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14410
I20260619 04:39:39.498690 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14542
Jun 19 04:39:39 dist-test-slave-9dgf krb5kdc[14172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:39.517254 14686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:39.499648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50526 (local address 127.9.224.67:40659)
0619 04:39:39.499909 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:39.499916 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:39.499938 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:39:39.500005 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:39.500011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:39.500130 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:39.500264 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:39.501526 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.502985 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.504268 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:39.504961 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:39.505101 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:39.510105 (+ 5004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:39.510126 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:39.510156 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:39.510202 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:39.514257 (+ 4055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:39.514932 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:39.514942 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:39.514945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:39.515185 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:39.515553 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:39.515559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:39.515564 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:39.516050 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:39.516409 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:39.516594 (+ 185us) server_negotiation.cc:299] Negotiation successful
0619 04:39:39.516817 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:39.518029 14664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:39.645247 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14542
I20260619 04:39:39.664601 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14185
I20260619 04:39:39.665745 14246 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:39.773895 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14185
2026-06-19T04:39:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4385 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-06-19T04:39:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:39Z Disabled control of system clock
I20260619 04:39:39.842332 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:41945
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:41945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 04:39:40.166798 14721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:40.167101 14721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:40.167186 14721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:40.174502 14721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:40.174619 14721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:40.174656 14721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:40.174719 14721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:40.174763 14721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:40.184016 14721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:41945
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:41945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:40.185310 14721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:40.187086 14721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:40.199318 14729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:40.199404 14726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:40.199424 14727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:40.200294 14721 server_base.cc:1034] running on GCE node
I20260619 04:39:40.201164 14721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:40.202688 14721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:40.203889 14721 hybrid_clock.cc:648] HybridClock initialized: now 1781843980203826 us; error 57 us; skew 500 ppm
I20260619 04:39:40.204252 14721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:40.206609 14721 webserver.cc:460] Webserver started at http://127.9.224.126:39293/ using document root <none> and password file <none>
I20260619 04:39:40.207329 14721 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:40.207417 14721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:40.207746 14721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:40.210784 14721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "2c576657aa464cf6800970b3ee970861"
format_stamp: "Formatted at 2026-06-19 04:39:40 on dist-test-slave-9dgf"
server_key: "57a7d58f41160d313aea0d7074280cd9"
server_key_iv: "f2cc0b52b59cbc0e52053b42883b62a1"
server_key_version: "encryptionkey@0"
I20260619 04:39:40.211655 14721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "2c576657aa464cf6800970b3ee970861"
format_stamp: "Formatted at 2026-06-19 04:39:40 on dist-test-slave-9dgf"
server_key: "57a7d58f41160d313aea0d7074280cd9"
server_key_iv: "f2cc0b52b59cbc0e52053b42883b62a1"
server_key_version: "encryptionkey@0"
I20260619 04:39:40.216832 14721 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:39:40.220235 14735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:40.221611 14721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:39:40.221784 14721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "2c576657aa464cf6800970b3ee970861"
format_stamp: "Formatted at 2026-06-19 04:39:40 on dist-test-slave-9dgf"
server_key: "57a7d58f41160d313aea0d7074280cd9"
server_key_iv: "f2cc0b52b59cbc0e52053b42883b62a1"
server_key_version: "encryptionkey@0"
I20260619 04:39:40.221999 14721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:40.227556 14721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:40.228302 14721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:40.228593 14721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:40.246965 14721 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:41945
I20260619 04:39:40.246989 14786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:41945 every 8 connection(s)
I20260619 04:39:40.248394 14721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:40.251645 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14721
I20260619 04:39:40.251863 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:40.252599 14787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:40.252621 10113 external_mini_cluster.cc:1428] Setting key 7d8dffa56b3c271b10c0275a5e0226f3
I20260619 04:39:40.262204 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:40.254962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.9.224.126:41945)
0619 04:39:40.256141 (+ 1179us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:40.256156 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:40.256210 (+ 54us) server_negotiation.cc:407] Connection header received
0619 04:39:40.258033 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:40.258062 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:40.258688 (+ 626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:40.259163 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:40.260202 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:40.260210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:40.260233 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:40.260252 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:40.260338 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:40.260362 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:40.260601 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:40.260739 (+ 138us) server_negotiation.cc:299] Negotiation successful
0619 04:39:40.261019 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":351,"threads_started":1}
I20260619 04:39:40.268127 14787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861: Bootstrap starting.
I20260619 04:39:40.271179 14787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:40.272215 14787 log.cc:824] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:40.275213 14787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861: No bootstrap required, opened a new log
I20260619 04:39:40.283004 14787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c576657aa464cf6800970b3ee970861" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 41945 } }
I20260619 04:39:40.283433 14787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:40.283618 14787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c576657aa464cf6800970b3ee970861, State: Initialized, Role: FOLLOWER
I20260619 04:39:40.284360 14787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c576657aa464cf6800970b3ee970861" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 41945 } }
I20260619 04:39:40.284588 14787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:40.284773 14787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:40.284989 14787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:40.287801 14787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c576657aa464cf6800970b3ee970861" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 41945 } }
I20260619 04:39:40.288384 14787 leader_election.cc:302] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c576657aa464cf6800970b3ee970861; no voters:
I20260619 04:39:40.289058 14787 leader_election.cc:288] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:40.289213 14792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:40.290004 14792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [term 1 LEADER]: Becoming Leader. State: Replica: 2c576657aa464cf6800970b3ee970861, State: Running, Role: LEADER
I20260619 04:39:40.290598 14792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c576657aa464cf6800970b3ee970861" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 41945 } }
I20260619 04:39:40.291347 14787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:40.293682 14794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c576657aa464cf6800970b3ee970861. Latest consensus state: current_term: 1 leader_uuid: "2c576657aa464cf6800970b3ee970861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c576657aa464cf6800970b3ee970861" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 41945 } } }
I20260619 04:39:40.294169 14794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:40.293656 14793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c576657aa464cf6800970b3ee970861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c576657aa464cf6800970b3ee970861" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 41945 } } }
I20260619 04:39:40.294838 14793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:40.296391 14799 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:40.301859 14799 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:40.310775 14799 catalog_manager.cc:1347] Generated new cluster ID: d25610211299457a8385bb0f89631871
I20260619 04:39:40.310913 14799 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:40.354779 14799 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:40.355296 14799 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:40.363866 14799 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861: Generated new TSK 0
I20260619 04:39:40.364889 14799 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:39:40.380797 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:41945
--builtin_ntp_servers=127.9.224.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 04:39:40.739794 14811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:40.740229 14811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:40.740377 14811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:40.749864 14811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:40.750010 14811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:40.750180 14811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:40.759737 14811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:41945
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:40.761107 14811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:40.763166 14811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:40.777297 14816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:40.777290 14819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:40.777256 14817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:40.778575 14811 server_base.cc:1034] running on GCE node
I20260619 04:39:40.779277 14811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:40.780282 14811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:40.781558 14811 hybrid_clock.cc:648] HybridClock initialized: now 1781843980781500 us; error 30 us; skew 500 ppm
I20260619 04:39:40.782004 14811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:40.784400 14811 webserver.cc:460] Webserver started at http://127.9.224.65:36495/ using document root <none> and password file <none>
I20260619 04:39:40.785145 14811 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:40.785282 14811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:40.785629 14811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:40.789507 14811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "565c9f4af10b4ad097ca7c866cf2863d"
format_stamp: "Formatted at 2026-06-19 04:39:40 on dist-test-slave-9dgf"
server_key: "dda724409d1095a2b47f5e3d76d50a34"
server_key_iv: "c8c2c29753b19bf4e2f7ae1948193fdd"
server_key_version: "encryptionkey@0"
I20260619 04:39:40.790429 14811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "565c9f4af10b4ad097ca7c866cf2863d"
format_stamp: "Formatted at 2026-06-19 04:39:40 on dist-test-slave-9dgf"
server_key: "dda724409d1095a2b47f5e3d76d50a34"
server_key_iv: "c8c2c29753b19bf4e2f7ae1948193fdd"
server_key_version: "encryptionkey@0"
I20260619 04:39:40.796582 14811 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260619 04:39:40.800518 14825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:40.802109 14811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260619 04:39:40.802340 14811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "565c9f4af10b4ad097ca7c866cf2863d"
format_stamp: "Formatted at 2026-06-19 04:39:40 on dist-test-slave-9dgf"
server_key: "dda724409d1095a2b47f5e3d76d50a34"
server_key_iv: "c8c2c29753b19bf4e2f7ae1948193fdd"
server_key_version: "encryptionkey@0"
I20260619 04:39:40.802580 14811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:40.808329 14811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:40.809147 14811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:40.809427 14811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:40.810443 14811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:40.811847 14811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:40.811970 14811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:40.812122 14811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:40.812209 14811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:40.845889 14811 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:42109
I20260619 04:39:40.845938 14937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:42109 every 8 connection(s)
I20260619 04:39:40.847376 14811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:40.853672 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14811
I20260619 04:39:40.853873 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:40.854677 10113 external_mini_cluster.cc:1428] Setting key f78d0e6ab73abf889e5574175cff201e
I20260619 04:39:40.856020 14940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:40.850050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:46859 (local address 127.9.224.126:41945)
0619 04:39:40.850562 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:40.850567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:40.851758 (+ 1191us) server_negotiation.cc:407] Connection header received
0619 04:39:40.853424 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:40.853430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:40.853509 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:40.853627 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:40.855150 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:40.855162 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:40.855165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:40.855181 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:40.855223 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:40.855236 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:40.855364 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:40.855602 (+ 238us) server_negotiation.cc:299] Negotiation successful
0619 04:39:40.855680 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":298,"threads_started":1}
I20260619 04:39:40.856938 14941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:40.850694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:41945 (local address 127.9.224.65:46859)
0619 04:39:40.851589 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:40.851633 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:40.853164 (+ 1531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:40.853905 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:40.853914 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:40.854044 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:40.854836 (+ 792us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:40.854840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:40.854888 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:40.854975 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:40.855338 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:40.855350 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:40.855357 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 04:39:40.855663 (+ 306us) client_negotiation.cc:240] Negotiation successful
0619 04:39:40.855883 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":260,"threads_started":1}
I20260619 04:39:40.857617 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:41945
--builtin_ntp_servers=127.9.224.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260619 04:39:40.858544 14938 heartbeater.cc:347] Connected to a master server at 127.9.224.126:41945
I20260619 04:39:40.858880 14938 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:40.859596 14938 heartbeater.cc:511] Master 127.9.224.126:41945 requested a full tablet report, sending...
I20260619 04:39:40.861850 14752 ts_manager.cc:194] Registered new tserver with Master: 565c9f4af10b4ad097ca7c866cf2863d (127.9.224.65:42109)
W20260619 04:39:41.191244 14942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:41.191645 14942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:41.191797 14942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:41.200277 14942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:41.200443 14942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:41.200649 14942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:41.212846 14942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:41945
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:41.214455 14942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:41.216470 14942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:41.231110 14950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:41.231061 14948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:41.231557 14947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:41.231967 14942 server_base.cc:1034] running on GCE node
I20260619 04:39:41.232661 14942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:41.233692 14942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:41.234917 14942 hybrid_clock.cc:648] HybridClock initialized: now 1781843981234859 us; error 53 us; skew 500 ppm
I20260619 04:39:41.235258 14942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:41.237648 14942 webserver.cc:460] Webserver started at http://127.9.224.66:42173/ using document root <none> and password file <none>
I20260619 04:39:41.238405 14942 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:41.238528 14942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:41.238858 14942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:41.241743 14942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "1815b452d2144fe88a0fdfc5fe358f53"
format_stamp: "Formatted at 2026-06-19 04:39:41 on dist-test-slave-9dgf"
server_key: "e60290f2581ea8e482c62aa30aaeb7f2"
server_key_iv: "869d0676fc16aa4b32ed3d7e61c331b1"
server_key_version: "encryptionkey@0"
I20260619 04:39:41.242668 14942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "1815b452d2144fe88a0fdfc5fe358f53"
format_stamp: "Formatted at 2026-06-19 04:39:41 on dist-test-slave-9dgf"
server_key: "e60290f2581ea8e482c62aa30aaeb7f2"
server_key_iv: "869d0676fc16aa4b32ed3d7e61c331b1"
server_key_version: "encryptionkey@0"
I20260619 04:39:41.248272 14942 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:39:41.252702 14956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:41.254323 14942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 04:39:41.254489 14942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "1815b452d2144fe88a0fdfc5fe358f53"
format_stamp: "Formatted at 2026-06-19 04:39:41 on dist-test-slave-9dgf"
server_key: "e60290f2581ea8e482c62aa30aaeb7f2"
server_key_iv: "869d0676fc16aa4b32ed3d7e61c331b1"
server_key_version: "encryptionkey@0"
I20260619 04:39:41.254740 14942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:41.262131 14942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:41.263214 14942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:41.263504 14942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:41.264597 14942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:41.266424 14942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:41.266535 14942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:41.266647 14942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:41.266714 14942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:41.300877 14942 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:39761
I20260619 04:39:41.300927 15068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:39761 every 8 connection(s)
I20260619 04:39:41.302284 14942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:41.309062 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 14942
I20260619 04:39:41.309237 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:41.309676 10113 external_mini_cluster.cc:1428] Setting key cc28bad8723482cea8ec008920849dd8
I20260619 04:39:41.310923 14940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.304915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:51945 (local address 127.9.224.126:41945)
0619 04:39:41.305090 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.305094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.306737 (+ 1643us) server_negotiation.cc:407] Connection header received
0619 04:39:41.308518 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.308522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.308596 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.308711 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.310114 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.310119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.310124 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.310143 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.310180 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.310191 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.310356 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.310572 (+ 216us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.310628 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:39:41.311913 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.305507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:41945 (local address 127.9.224.66:51945)
0619 04:39:41.306594 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.306639 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.308250 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.308942 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.308950 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.309043 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.309821 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.309823 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.309862 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.309950 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.310327 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.310337 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.310345 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.310626 (+ 281us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.310864 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":270,"threads_started":1}
I20260619 04:39:41.312647 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:41945
--builtin_ntp_servers=127.9.224.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260619 04:39:41.313426 15069 heartbeater.cc:347] Connected to a master server at 127.9.224.126:41945
I20260619 04:39:41.313774 15069 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:41.314510 15069 heartbeater.cc:511] Master 127.9.224.126:41945 requested a full tablet report, sending...
I20260619 04:39:41.316252 14752 ts_manager.cc:194] Registered new tserver with Master: 1815b452d2144fe88a0fdfc5fe358f53 (127.9.224.66:39761)
W20260619 04:39:41.652513 15072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:41.652849 15072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:41.653021 15072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:41.661080 15072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:41.661218 15072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:41.661402 15072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:41.671139 15072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:41945
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:41.672683 15072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:41.674736 15072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:41.688805 15080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:41.688845 15078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:41.688868 15077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:41.689992 15072 server_base.cc:1034] running on GCE node
I20260619 04:39:41.690707 15072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:41.691919 15072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:41.693138 15072 hybrid_clock.cc:648] HybridClock initialized: now 1781843981693064 us; error 85 us; skew 500 ppm
I20260619 04:39:41.693488 15072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:41.695966 15072 webserver.cc:460] Webserver started at http://127.9.224.67:41453/ using document root <none> and password file <none>
I20260619 04:39:41.696725 15072 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:41.696856 15072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:41.697189 15072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:41.700223 15072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "bade4fd7a1354f6b997ba039ae895924"
format_stamp: "Formatted at 2026-06-19 04:39:41 on dist-test-slave-9dgf"
server_key: "b1f3c1b434ecfd6c0eb319dc739d323e"
server_key_iv: "392ea85b7bd5059778dd1b2991acbc70"
server_key_version: "encryptionkey@0"
I20260619 04:39:41.701081 15072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "bade4fd7a1354f6b997ba039ae895924"
format_stamp: "Formatted at 2026-06-19 04:39:41 on dist-test-slave-9dgf"
server_key: "b1f3c1b434ecfd6c0eb319dc739d323e"
server_key_iv: "392ea85b7bd5059778dd1b2991acbc70"
server_key_version: "encryptionkey@0"
I20260619 04:39:41.706915 15072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260619 04:39:41.710779 15086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:41.712379 15072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:41.712625 15072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "bade4fd7a1354f6b997ba039ae895924"
format_stamp: "Formatted at 2026-06-19 04:39:41 on dist-test-slave-9dgf"
server_key: "b1f3c1b434ecfd6c0eb319dc739d323e"
server_key_iv: "392ea85b7bd5059778dd1b2991acbc70"
server_key_version: "encryptionkey@0"
I20260619 04:39:41.712879 15072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:41.719094 15072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:41.719965 15072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:41.720247 15072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:41.721213 15072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:41.722795 15072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:41.722915 15072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:41.723048 15072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:41.723133 15072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:41.757714 15072 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:41793
I20260619 04:39:41.757804 15198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:41793 every 8 connection(s)
I20260619 04:39:41.759189 15072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:41.764744 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15072
I20260619 04:39:41.764946 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:41.765396 10113 external_mini_cluster.cc:1428] Setting key 9bd9eb9e1ec6d746249933f659b71814
I20260619 04:39:41.768745 14940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.761998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:36111 (local address 127.9.224.126:41945)
0619 04:39:41.762206 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.762211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.763883 (+ 1672us) server_negotiation.cc:407] Connection header received
0619 04:39:41.766005 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.766012 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.766101 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.766254 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.767925 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.767931 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.767936 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.767957 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.768000 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.768026 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.768158 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.768328 (+ 170us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.768409 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 04:39:41.769675 15201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.762617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:41945 (local address 127.9.224.67:36111)
0619 04:39:41.763677 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.763720 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.765661 (+ 1941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.766552 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.766563 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.766677 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.767531 (+ 854us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.767534 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.767596 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.767728 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.768129 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.768137 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.768143 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.768373 (+ 230us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.768639 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":345,"threads_started":1}
I20260619 04:39:41.771108 15199 heartbeater.cc:347] Connected to a master server at 127.9.224.126:41945
I20260619 04:39:41.771411 15199 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:41.772009 15199 heartbeater.cc:511] Master 127.9.224.126:41945 requested a full tablet report, sending...
I20260619 04:39:41.773546 14752 ts_manager.cc:194] Registered new tserver with Master: bade4fd7a1354f6b997ba039ae895924 (127.9.224.67:41793)
I20260619 04:39:41.781865 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:39:41.789192 14940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.786473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33538 (local address 127.9.224.126:41945)
0619 04:39:41.786668 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.786677 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.787168 (+ 491us) server_negotiation.cc:407] Connection header received
0619 04:39:41.787366 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.787371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.787434 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.787538 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.788566 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.788571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.788574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.788591 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.788627 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.788640 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.788775 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.788852 (+ 77us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.788920 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 04:39:41.794175 14752 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33538:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:41.801295 14752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:41.820016 15211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.814387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:41793 (local address 127.0.0.1:49190)
0619 04:39:41.815250 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.815303 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.815436 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.816755 (+ 1319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.816766 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.816875 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.817946 (+ 1071us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.817952 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.817993 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.818120 (+ 127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.819219 (+ 1099us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.819231 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.819238 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.819383 (+ 145us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.819488 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":420,"threads_started":1}
I20260619 04:39:41.821043 15213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.815327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:39761 (local address 127.0.0.1:37990)
0619 04:39:41.816460 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.816484 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.816608 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.818473 (+ 1865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.818485 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.818515 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.819195 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.819201 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.819225 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.819264 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.820423 (+ 1159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.820428 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.820435 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.820579 (+ 144us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.820632 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":983,"thread_start_us":1005,"threads_started":1}
I20260619 04:39:41.821135 15212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.814634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49190 (local address 127.9.224.67:41793)
0619 04:39:41.816035 (+ 1401us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.816056 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.816101 (+ 45us) server_negotiation.cc:407] Connection header received
0619 04:39:41.816185 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.816193 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.816502 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.817803 (+ 1301us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.818969 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.818978 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.818993 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.819010 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.819069 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.819089 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.820592 (+ 1503us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.820657 (+ 65us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.820759 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1226,"thread_start_us":1057,"threads_started":1}
I20260619 04:39:41.821879 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.816179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.9.224.66:39761)
0619 04:39:41.817782 (+ 1603us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.817792 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.817821 (+ 29us) server_negotiation.cc:407] Connection header received
0619 04:39:41.817886 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.817893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.818248 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.818947 (+ 699us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.820177 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.820187 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.820201 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.820225 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.820283 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.820300 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.821430 (+ 1130us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.821502 (+ 72us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.821594 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":1342,"threads_started":1}
I20260619 04:39:41.822441 15214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.815727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:42109 (local address 127.0.0.1:37852)
0619 04:39:41.818644 (+ 2917us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.818667 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.818775 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.819794 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.819799 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.819821 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.820586 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.820590 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.820606 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.820649 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.821737 (+ 1088us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.821742 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.821747 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.821901 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.821952 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2786,"thread_start_us":2793,"threads_started":1}
I20260619 04:39:41.822769 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.816296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37852 (local address 127.9.224.65:42109)
0619 04:39:41.817260 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.817273 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.819148 (+ 1875us) server_negotiation.cc:407] Connection header received
0619 04:39:41.819441 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.819455 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.819639 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.819794 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.821293 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.821301 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.821312 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.821333 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.821379 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.821397 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.821546 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.822336 (+ 790us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.822449 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":549,"threads_started":1}
I20260619 04:39:41.824899 15134 tablet_service.cc:1467] Processing CreateTablet for tablet bcad400a0a8f46e6a4a3c231a1d1a39d (DEFAULT_TABLE table=test-table [id=b796c6b04c744abea157d380a059c68d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:41.826119 15004 tablet_service.cc:1467] Processing CreateTablet for tablet bcad400a0a8f46e6a4a3c231a1d1a39d (DEFAULT_TABLE table=test-table [id=b796c6b04c744abea157d380a059c68d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:41.826119 14873 tablet_service.cc:1467] Processing CreateTablet for tablet bcad400a0a8f46e6a4a3c231a1d1a39d (DEFAULT_TABLE table=test-table [id=b796c6b04c744abea157d380a059c68d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:41.826740 15134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcad400a0a8f46e6a4a3c231a1d1a39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:41.827493 14873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcad400a0a8f46e6a4a3c231a1d1a39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:41.827493 15004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcad400a0a8f46e6a4a3c231a1d1a39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:41.838490 15217 tablet_bootstrap.cc:492] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Bootstrap starting.
I20260619 04:39:41.842248 15217 tablet_bootstrap.cc:654] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:41.842641 15219 tablet_bootstrap.cc:492] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Bootstrap starting.
I20260619 04:39:41.843819 15217 log.cc:824] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:41.845412 15218 tablet_bootstrap.cc:492] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Bootstrap starting.
I20260619 04:39:41.846869 15219 tablet_bootstrap.cc:654] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:41.848273 15217 tablet_bootstrap.cc:492] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: No bootstrap required, opened a new log
I20260619 04:39:41.848611 15217 ts_tablet_manager.cc:1397] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260619 04:39:41.848774 15219 log.cc:824] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:41.851950 15218 tablet_bootstrap.cc:654] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:41.853757 15218 log.cc:824] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:41.859577 15217 raft_consensus.cc:348] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.860237 15217 raft_consensus.cc:374] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:41.860404 15217 raft_consensus.cc:729] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bade4fd7a1354f6b997ba039ae895924, State: Initialized, Role: FOLLOWER
I20260619 04:39:41.861191 15217 consensus_queue.cc:260] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.862794 15219 tablet_bootstrap.cc:492] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: No bootstrap required, opened a new log
I20260619 04:39:41.863001 15199 heartbeater.cc:503] Master 127.9.224.126:41945 was elected leader, sending a full tablet report...
I20260619 04:39:41.863130 15219 ts_tablet_manager.cc:1397] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.007s
I20260619 04:39:41.863188 15218 tablet_bootstrap.cc:492] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: No bootstrap required, opened a new log
I20260619 04:39:41.863447 15218 ts_tablet_manager.cc:1397] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.001s
I20260619 04:39:41.863721 15217 ts_tablet_manager.cc:1428] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
I20260619 04:39:41.865260 14938 heartbeater.cc:503] Master 127.9.224.126:41945 was elected leader, sending a full tablet report...
I20260619 04:39:41.872983 15218 raft_consensus.cc:348] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.872983 15219 raft_consensus.cc:348] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.873363 15218 raft_consensus.cc:374] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:41.873399 15219 raft_consensus.cc:374] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:41.873487 15218 raft_consensus.cc:729] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565c9f4af10b4ad097ca7c866cf2863d, State: Initialized, Role: FOLLOWER
I20260619 04:39:41.873517 15219 raft_consensus.cc:729] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1815b452d2144fe88a0fdfc5fe358f53, State: Initialized, Role: FOLLOWER
I20260619 04:39:41.874074 15218 consensus_queue.cc:260] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.874110 15219 consensus_queue.cc:260] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.875305 15069 heartbeater.cc:503] Master 127.9.224.126:41945 was elected leader, sending a full tablet report...
I20260619 04:39:41.876045 15218 ts_tablet_manager.cc:1428] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Time spent starting tablet: real 0.012s user 0.005s sys 0.007s
I20260619 04:39:41.876065 15219 ts_tablet_manager.cc:1428] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260619 04:39:41.888135 15225 raft_consensus.cc:482] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:41.888443 15225 raft_consensus.cc:504] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.890051 15225 leader_election.cc:288] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bade4fd7a1354f6b997ba039ae895924 (127.9.224.67:41793), 565c9f4af10b4ad097ca7c866cf2863d (127.9.224.65:42109)
I20260619 04:39:41.893493 15212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.890481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:44035 (local address 127.9.224.67:41793)
0619 04:39:41.890664 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.890668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.891215 (+ 547us) server_negotiation.cc:407] Connection header received
0619 04:39:41.891530 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.891536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.891598 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.891695 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.892900 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.892908 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.892914 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.892934 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.892971 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.892989 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.893114 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.893198 (+ 84us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.893262 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:39:41.893778 15226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.890362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:41793 (local address 127.9.224.66:44035)
0619 04:39:41.891119 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.891139 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.891314 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.891883 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.891904 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.891930 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.892687 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.892690 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.892704 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.892756 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.893101 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.893105 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.893109 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.893260 (+ 151us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.893315 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":334,"threads_started":1}
I20260619 04:39:41.893958 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.891347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:43257 (local address 127.9.224.65:42109)
0619 04:39:41.891558 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.891563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.891974 (+ 411us) server_negotiation.cc:407] Connection header received
0619 04:39:41.892215 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.892220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.892274 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.892373 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.893276 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.893282 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.893287 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.893304 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.893343 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.893358 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.893477 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.893609 (+ 132us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.893672 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 04:39:41.894147 15227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.891169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:42109 (local address 127.9.224.66:43257)
0619 04:39:41.891871 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:41.891891 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:41.892030 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:41.892391 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:41.892397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:41.892418 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:41.893069 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:39:41.893072 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:41.893087 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:39:41.893132 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:41.893461 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:41.893466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:41.893471 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 04:39:41.893625 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 04:39:41.893685 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":312,"threads_started":1}
I20260619 04:39:41.894887 15154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcad400a0a8f46e6a4a3c231a1d1a39d" candidate_uuid: "1815b452d2144fe88a0fdfc5fe358f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bade4fd7a1354f6b997ba039ae895924" is_pre_election: true
I20260619 04:39:41.894968 14893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcad400a0a8f46e6a4a3c231a1d1a39d" candidate_uuid: "1815b452d2144fe88a0fdfc5fe358f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c9f4af10b4ad097ca7c866cf2863d" is_pre_election: true
I20260619 04:39:41.895421 15154 raft_consensus.cc:2454] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1815b452d2144fe88a0fdfc5fe358f53 in term 0.
I20260619 04:39:41.895462 14893 raft_consensus.cc:2454] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1815b452d2144fe88a0fdfc5fe358f53 in term 0.
I20260619 04:39:41.896050 14958 leader_election.cc:302] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1815b452d2144fe88a0fdfc5fe358f53, 565c9f4af10b4ad097ca7c866cf2863d; no voters:
I20260619 04:39:41.896445 15225 raft_consensus.cc:2781] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:41.896600 15225 raft_consensus.cc:482] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:41.896703 15225 raft_consensus.cc:3037] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:41.899165 15225 raft_consensus.cc:504] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.899812 15225 leader_election.cc:288] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [CANDIDATE]: Term 1 election: Requested vote from peers bade4fd7a1354f6b997ba039ae895924 (127.9.224.67:41793), 565c9f4af10b4ad097ca7c866cf2863d (127.9.224.65:42109)
I20260619 04:39:41.900323 15154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcad400a0a8f46e6a4a3c231a1d1a39d" candidate_uuid: "1815b452d2144fe88a0fdfc5fe358f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bade4fd7a1354f6b997ba039ae895924"
I20260619 04:39:41.900378 14893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcad400a0a8f46e6a4a3c231a1d1a39d" candidate_uuid: "1815b452d2144fe88a0fdfc5fe358f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c9f4af10b4ad097ca7c866cf2863d"
I20260619 04:39:41.900538 15154 raft_consensus.cc:3037] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:41.900594 14893 raft_consensus.cc:3037] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:41.903843 15154 raft_consensus.cc:2454] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1815b452d2144fe88a0fdfc5fe358f53 in term 1.
I20260619 04:39:41.903843 14893 raft_consensus.cc:2454] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1815b452d2144fe88a0fdfc5fe358f53 in term 1.
I20260619 04:39:41.904215 14958 leader_election.cc:302] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1815b452d2144fe88a0fdfc5fe358f53, bade4fd7a1354f6b997ba039ae895924; no voters:
I20260619 04:39:41.904510 15225 raft_consensus.cc:2781] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:41.904947 15225 raft_consensus.cc:686] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 1 LEADER]: Becoming Leader. State: Replica: 1815b452d2144fe88a0fdfc5fe358f53, State: Running, Role: LEADER
I20260619 04:39:41.905478 15225 consensus_queue.cc:237] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } }
I20260619 04:39:41.910177 14752 catalog_manager.cc:5495] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1815b452d2144fe88a0fdfc5fe358f53 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "1815b452d2144fe88a0fdfc5fe358f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1815b452d2144fe88a0fdfc5fe358f53" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39761 } health_report { overall_health: HEALTHY } } }
I20260619 04:39:41.927876 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.925360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38006 (local address 127.9.224.66:39761)
0619 04:39:41.925647 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.925655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.925805 (+ 150us) server_negotiation.cc:407] Connection header received
0619 04:39:41.926083 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.926087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.926166 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.926305 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.927260 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.927264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.927267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.927282 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.927315 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.927327 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.927442 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.927548 (+ 106us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.927612 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260619 04:39:41.936940 14893 raft_consensus.cc:1261] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 1 FOLLOWER]: Refusing update from remote peer 1815b452d2144fe88a0fdfc5fe358f53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:41.936940 15154 raft_consensus.cc:1261] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 1 FOLLOWER]: Refusing update from remote peer 1815b452d2144fe88a0fdfc5fe358f53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:41.937989 15228 consensus_queue.cc:1035] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "565c9f4af10b4ad097ca7c866cf2863d" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 42109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:41.938463 15225 consensus_queue.cc:1035] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bade4fd7a1354f6b997ba039ae895924" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:41.950736 15231 mvcc.cc:205] Tried to move back new op lower bound from 7298432950001819648 to 7298432949889630208. Current Snapshot: MvccSnapshot[applied={T|T < 7298432950001819648}]
I20260619 04:39:41.965209 14752 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33538:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:41.965474 14752 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33538:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:41.968925 14752 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c576657aa464cf6800970b3ee970861: Sending DeleteTablet for 3 replicas of tablet bcad400a0a8f46e6a4a3c231a1d1a39d
I20260619 04:39:41.970265 14873 tablet_service.cc:1514] Processing DeleteTablet for tablet bcad400a0a8f46e6a4a3c231a1d1a39d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:41 UTC) from {username='slave'} at 127.0.0.1:37852
I20260619 04:39:41.970484 15004 tablet_service.cc:1514] Processing DeleteTablet for tablet bcad400a0a8f46e6a4a3c231a1d1a39d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:41 UTC) from {username='slave'} at 127.0.0.1:37990
I20260619 04:39:41.971002 15134 tablet_service.cc:1514] Processing DeleteTablet for tablet bcad400a0a8f46e6a4a3c231a1d1a39d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:41 UTC) from {username='slave'} at 127.0.0.1:49190
I20260619 04:39:41.971303 15241 tablet_replica.cc:330] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: stopping tablet replica
I20260619 04:39:41.971910 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14811
I20260619 04:39:41.971859 15241 raft_consensus.cc:2229] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:41.972476 15241 raft_consensus.cc:2258] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:41.973242 15242 tablet_replica.cc:330] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: stopping tablet replica
I20260619 04:39:41.973629 15242 raft_consensus.cc:2229] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:41.974263 15242 raft_consensus.cc:2258] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:41.976349 15241 ts_tablet_manager.cc:1905] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:41.976349 15242 ts_tablet_manager.cc:1905] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:41.983588 15242 ts_tablet_manager.cc:1918] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:41.983587 15241 ts_tablet_manager.cc:1918] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:41.983767 15242 log.cc:1196] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/bcad400a0a8f46e6a4a3c231a1d1a39d
I20260619 04:39:41.983767 15241 log.cc:1196] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/bcad400a0a8f46e6a4a3c231a1d1a39d
I20260619 04:39:41.984294 15242 ts_tablet_manager.cc:1939] T bcad400a0a8f46e6a4a3c231a1d1a39d P 1815b452d2144fe88a0fdfc5fe358f53: Deleting consensus metadata
I20260619 04:39:41.984294 15241 ts_tablet_manager.cc:1939] T bcad400a0a8f46e6a4a3c231a1d1a39d P 565c9f4af10b4ad097ca7c866cf2863d: Deleting consensus metadata
I20260619 04:39:41.986290 14738 catalog_manager.cc:4841] TS 1815b452d2144fe88a0fdfc5fe358f53 (127.9.224.66:39761): tablet bcad400a0a8f46e6a4a3c231a1d1a39d (table test-table [id=b796c6b04c744abea157d380a059c68d]) successfully deleted
I20260619 04:39:41.986481 14737 catalog_manager.cc:4841] TS 565c9f4af10b4ad097ca7c866cf2863d (127.9.224.65:42109): tablet bcad400a0a8f46e6a4a3c231a1d1a39d (table test-table [id=b796c6b04c744abea157d380a059c68d]) successfully deleted
I20260619 04:39:41.987978 15243 tablet_replica.cc:330] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: stopping tablet replica
I20260619 04:39:41.988474 15243 raft_consensus.cc:2229] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:41.989070 15243 raft_consensus.cc:2258] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:41.989423 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:41.974774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37856 (local address 127.9.224.65:42109)
0619 04:39:41.974949 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:41.974955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:41.987036 (+ 12081us) server_negotiation.cc:407] Connection header received
0619 04:39:41.987265 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:41.987271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:41.987373 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:41.987482 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:41.988734 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:41.988740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:41.988745 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:41.988768 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:41.988806 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:41.988821 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:41.988963 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:41.989094 (+ 131us) server_negotiation.cc:299] Negotiation successful
0619 04:39:41.989160 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:39:41.990295 14933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:41.991600 15243 ts_tablet_manager.cc:1905] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:41.999399 15243 ts_tablet_manager.cc:1918] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:41.999605 15243 log.cc:1196] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/bcad400a0a8f46e6a4a3c231a1d1a39d
I20260619 04:39:42.000280 15243 ts_tablet_manager.cc:1939] T bcad400a0a8f46e6a4a3c231a1d1a39d P bade4fd7a1354f6b997ba039ae895924: Deleting consensus metadata
I20260619 04:39:42.002393 14737 catalog_manager.cc:4841] TS bade4fd7a1354f6b997ba039ae895924 (127.9.224.67:41793): tablet bcad400a0a8f46e6a4a3c231a1d1a39d (table test-table [id=b796c6b04c744abea157d380a059c68d]) successfully deleted
I20260619 04:39:42.082559 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14811
I20260619 04:39:42.100510 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14942
I20260619 04:39:42.103530 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:42.101341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38020 (local address 127.9.224.66:39761)
0619 04:39:42.101533 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:42.101539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:42.101561 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:39:42.101738 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:42.101744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:42.101810 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:42.101922 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:42.102846 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:42.102854 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:42.102864 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:42.102883 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:42.102929 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:42.102944 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:42.103082 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:42.103161 (+ 79us) server_negotiation.cc:299] Negotiation successful
0619 04:39:42.103218 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:39:42.104297 15064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:42.213603 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14942
I20260619 04:39:42.231798 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15072
I20260619 04:39:42.234738 15212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:42.232550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.9.224.67:41793)
0619 04:39:42.232789 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:42.232794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:42.232815 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:39:42.232927 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:42.232936 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:42.233016 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:42.233122 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:42.234039 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:42.234045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:42.234050 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:42.234070 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:42.234101 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:42.234113 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:42.234274 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:42.234431 (+ 157us) server_negotiation.cc:299] Negotiation successful
0619 04:39:42.234492 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260619 04:39:42.235391 15194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:42.337572 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15072
I20260619 04:39:42.354130 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 14721
I20260619 04:39:42.355455 14782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:42.461951 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 14721
2026-06-19T04:39:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2686 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260619 04:39:42.503052 10113 mini_oidc.cc:152] Starting JWKS server
I20260619 04:39:42.505638 10113 webserver.cc:460] Webserver started at https://127.0.0.1:35187/ using document root <none> and password file <none>
I20260619 04:39:42.505975 10113 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 04:39:42.506769 10113 webserver.cc:460] Webserver started at http://127.0.0.1:35127/ using document root <none> and password file <none>
2026-06-19T04:39:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:42Z Disabled control of system clock
I20260619 04:39:42.535252 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:45219
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:42423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:45219
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35187/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/testchainca.cert with env {}
W20260619 04:39:42.872997 15254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:42.873435 15254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:42.873600 15254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:42.881215 15254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:42.881385 15254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:42.881465 15254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:42.881568 15254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:42.881645 15254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 04:39:42.881752 15254 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 04:39:42.881825 15254 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35187/jwks.json
I20260619 04:39:42.891986 15254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:45219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:45219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35187/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:42.893366 15254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:42.894717 15254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:42.906827 15259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:42.906939 15260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:42.906868 15262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:42.907735 15254 server_base.cc:1034] running on GCE node
I20260619 04:39:42.908641 15254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:42.910123 15254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:42.911388 15254 hybrid_clock.cc:648] HybridClock initialized: now 1781843982911334 us; error 47 us; skew 500 ppm
I20260619 04:39:42.911779 15254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:42.914327 15254 webserver.cc:460] Webserver started at http://127.9.224.126:35531/ using document root <none> and password file <none>
I20260619 04:39:42.915056 15254 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:42.915190 15254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:42.915509 15254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:42.919018 15254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "fba2c38de57a4a84b5ab776a289997ff"
format_stamp: "Formatted at 2026-06-19 04:39:42 on dist-test-slave-9dgf"
server_key: "70a51704b9c1b3e66cb52b0af734abb7"
server_key_iv: "e343109102c7bc9a3e003b2d7fd42b8f"
server_key_version: "encryptionkey@0"
I20260619 04:39:42.919845 15254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "fba2c38de57a4a84b5ab776a289997ff"
format_stamp: "Formatted at 2026-06-19 04:39:42 on dist-test-slave-9dgf"
server_key: "70a51704b9c1b3e66cb52b0af734abb7"
server_key_iv: "e343109102c7bc9a3e003b2d7fd42b8f"
server_key_version: "encryptionkey@0"
I20260619 04:39:42.925235 15254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260619 04:39:42.928957 15268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:42.930547 15254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:42.930737 15254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "fba2c38de57a4a84b5ab776a289997ff"
format_stamp: "Formatted at 2026-06-19 04:39:42 on dist-test-slave-9dgf"
server_key: "70a51704b9c1b3e66cb52b0af734abb7"
server_key_iv: "e343109102c7bc9a3e003b2d7fd42b8f"
server_key_version: "encryptionkey@0"
I20260619 04:39:42.930968 15254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:42.947857 15254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:42.948796 15254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:42.949127 15254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:42.968343 15254 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:45219
I20260619 04:39:42.968367 15319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:45219 every 8 connection(s)
I20260619 04:39:42.969741 15254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:42.973657 15320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:42.975557 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15254
I20260619 04:39:42.975775 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:42.976429 10113 external_mini_cluster.cc:1428] Setting key 5a8f3d2e93eb99cc469f0120dd1e819d
I20260619 04:39:42.989866 15320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff: Bootstrap starting.
I20260619 04:39:42.992865 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:42.978446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52530 (local address 127.9.224.126:45219)
0619 04:39:42.979617 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:42.979632 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:42.979683 (+ 51us) server_negotiation.cc:407] Connection header received
0619 04:39:42.981424 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:42.981470 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:42.982140 (+ 670us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:42.982646 (+ 506us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:42.983161 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:42.985134 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:42.987419 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:42.988514 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:42.988715 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:42.989841 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:42.989858 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:42.989877 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:42.990671 (+ 794us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:42.990776 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:42.990803 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:42.990923 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:42.991135 (+ 212us) server_negotiation.cc:299] Negotiation successful
0619 04:39:42.991485 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":351,"threads_started":1}
I20260619 04:39:42.993937 15320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:42.995052 15320 log.cc:824] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:42.996845 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:39:42.998402 15320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff: No bootstrap required, opened a new log
I20260619 04:39:43.006546 15320 raft_consensus.cc:348] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba2c38de57a4a84b5ab776a289997ff" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45219 } }
I20260619 04:39:43.006920 15320 raft_consensus.cc:374] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:43.007004 15320 raft_consensus.cc:729] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba2c38de57a4a84b5ab776a289997ff, State: Initialized, Role: FOLLOWER
I20260619 04:39:43.007586 15320 consensus_queue.cc:260] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba2c38de57a4a84b5ab776a289997ff" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45219 } }
I20260619 04:39:43.007855 15320 raft_consensus.cc:388] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:43.008050 15320 raft_consensus.cc:482] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:43.008265 15320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:43.010519 15320 raft_consensus.cc:504] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba2c38de57a4a84b5ab776a289997ff" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45219 } }
I20260619 04:39:43.011063 15320 leader_election.cc:302] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fba2c38de57a4a84b5ab776a289997ff; no voters:
I20260619 04:39:43.011739 15320 leader_election.cc:288] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:43.011955 15325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:43.012703 15325 raft_consensus.cc:686] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [term 1 LEADER]: Becoming Leader. State: Replica: fba2c38de57a4a84b5ab776a289997ff, State: Running, Role: LEADER
I20260619 04:39:43.013547 15325 consensus_queue.cc:237] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba2c38de57a4a84b5ab776a289997ff" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45219 } }
I20260619 04:39:43.014124 15320 sys_catalog.cc:564] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:43.016721 15326 sys_catalog.cc:455] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fba2c38de57a4a84b5ab776a289997ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba2c38de57a4a84b5ab776a289997ff" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45219 } } }
I20260619 04:39:43.016803 15327 sys_catalog.cc:455] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader fba2c38de57a4a84b5ab776a289997ff. Latest consensus state: current_term: 1 leader_uuid: "fba2c38de57a4a84b5ab776a289997ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba2c38de57a4a84b5ab776a289997ff" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45219 } } }
I20260619 04:39:43.017118 15326 sys_catalog.cc:458] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:43.017231 15327 sys_catalog.cc:458] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:43.018867 15333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:43.024202 15333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:43.032310 15333 catalog_manager.cc:1347] Generated new cluster ID: 597a25ea8d07411b95b5e7d9a7322dea
I20260619 04:39:43.032452 15333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:43.049409 15333 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:43.051405 15333 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:43.060559 15333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fba2c38de57a4a84b5ab776a289997ff: Generated new TSK 0
I20260619 04:39:43.061444 15333 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260619 04:39:43.106729 15350 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260619 04:39:43.106956 15350 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 04:39:43.108045 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:43.085850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52532 (local address 127.9.224.126:45219)
0619 04:39:43.086105 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:43.086115 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:43.086807 (+ 692us) server_negotiation.cc:407] Connection header received
0619 04:39:43.087181 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:43.087186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:43.087261 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:43.087388 (+ 127us) server_negotiation.cc:226] Negotiated authn=JWT
0619 04:39:43.088100 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.088849 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.091241 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.091707 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.091807 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:43.092545 (+ 738us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 04:39:43.107469 (+ 14924us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0619 04:39:43.107759 (+ 290us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52532: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":87}
W20260619 04:39:43.108181 15323 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52532: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260619 04:39:43.110270 15349 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:43.085817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45219 (local address 127.0.0.1:52532)
0619 04:39:43.086676 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:43.086699 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:43.086910 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:43.087457 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:43.087463 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:43.087477 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0619 04:39:43.087923 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:43.087934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.089001 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.089007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:43.091084 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:43.091102 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.091915 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.091922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:43.092138 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:43.092232 (+ 94us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 04:39:43.107776 (+ 15544us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0619 04:39:43.108212 (+ 436us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.224.126:45219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":449,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.9.224.126:45219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35187/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260619 04:39:43.112239 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15254
I20260619 04:39:43.113577 15315 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:43.206956 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15254
2026-06-19T04:39:43Z chronyd exiting
I20260619 04:39:43.257398 10113 test_util.cc:175] -----------------------------------------------
I20260619 04:39:43.257565 10113 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781843940819459-10113-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (758 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260619 04:39:43.261322 10113 mini_oidc.cc:152] Starting JWKS server
I20260619 04:39:43.263317 10113 webserver.cc:460] Webserver started at https://127.0.0.1:37773/ using document root <none> and password file <none>
I20260619 04:39:43.263559 10113 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 04:39:43.264233 10113 webserver.cc:460] Webserver started at http://127.0.0.1:42151/ using document root <none> and password file <none>
2026-06-19T04:39:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:43Z Disabled control of system clock
I20260619 04:39:43.293551 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40651
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:34173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:40651
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37773/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/testchainca.cert with env {}
W20260619 04:39:43.634968 15357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:43.635322 15357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:43.635473 15357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:43.642975 15357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:43.643131 15357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:43.643217 15357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:43.643321 15357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:43.643402 15357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 04:39:43.643499 15357 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 04:39:43.643574 15357 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37773/jwks.json
I20260619 04:39:43.654114 15357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:34173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:40651
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37773/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:43.655529 15357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:43.656961 15357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:43.669167 15365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:43.669179 15363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:43.669644 15362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:43.670075 15357 server_base.cc:1034] running on GCE node
I20260619 04:39:43.670920 15357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:43.672571 15357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:43.673772 15357 hybrid_clock.cc:648] HybridClock initialized: now 1781843983673713 us; error 55 us; skew 500 ppm
I20260619 04:39:43.674137 15357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:43.679888 15357 webserver.cc:460] Webserver started at http://127.9.224.126:42385/ using document root <none> and password file <none>
I20260619 04:39:43.680649 15357 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:43.680749 15357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:43.681073 15357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:43.684290 15357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "a77ba036678546e58c7cb1f4000ce255"
format_stamp: "Formatted at 2026-06-19 04:39:43 on dist-test-slave-9dgf"
server_key: "e04844f139023054f7012731edf8bc55"
server_key_iv: "fd5cbc0b67e30776d3149d2c16855d85"
server_key_version: "encryptionkey@0"
I20260619 04:39:43.685148 15357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "a77ba036678546e58c7cb1f4000ce255"
format_stamp: "Formatted at 2026-06-19 04:39:43 on dist-test-slave-9dgf"
server_key: "e04844f139023054f7012731edf8bc55"
server_key_iv: "fd5cbc0b67e30776d3149d2c16855d85"
server_key_version: "encryptionkey@0"
I20260619 04:39:43.690629 15357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:39:43.694110 15371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:43.695560 15357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:43.695745 15357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "a77ba036678546e58c7cb1f4000ce255"
format_stamp: "Formatted at 2026-06-19 04:39:43 on dist-test-slave-9dgf"
server_key: "e04844f139023054f7012731edf8bc55"
server_key_iv: "fd5cbc0b67e30776d3149d2c16855d85"
server_key_version: "encryptionkey@0"
I20260619 04:39:43.695971 15357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:43.743366 15357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:43.744349 15357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:43.744670 15357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:43.763621 15357 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:40651
I20260619 04:39:43.763639 15422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:40651 every 8 connection(s)
I20260619 04:39:43.765131 15357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:43.769176 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:43.775120 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15357
I20260619 04:39:43.775336 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:43.775982 10113 external_mini_cluster.cc:1428] Setting key ca626edb13281a7edd2b0d1bc7d2967f
I20260619 04:39:43.781459 15423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255: Bootstrap starting.
I20260619 04:39:43.785830 15423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:43.786991 15423 log.cc:824] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:43.790006 15423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255: No bootstrap required, opened a new log
I20260619 04:39:43.791833 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:43.778322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51744 (local address 127.9.224.126:40651)
0619 04:39:43.779493 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:43.779509 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:43.779562 (+ 53us) server_negotiation.cc:407] Connection header received
0619 04:39:43.782000 (+ 2438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:43.782031 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:43.782700 (+ 669us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:43.783167 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:43.783803 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.785817 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.787248 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.788101 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.788334 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:43.789494 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:43.789501 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:43.789517 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:43.790077 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:43.790178 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:43.790200 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:43.790348 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:43.790580 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 04:39:43.790882 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":345,"threads_started":1}
I20260619 04:39:43.795696 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:39:43.798882 15423 raft_consensus.cc:348] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77ba036678546e58c7cb1f4000ce255" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40651 } }
I20260619 04:39:43.799536 15423 raft_consensus.cc:374] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:43.799762 15423 raft_consensus.cc:729] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a77ba036678546e58c7cb1f4000ce255, State: Initialized, Role: FOLLOWER
I20260619 04:39:43.800521 15423 consensus_queue.cc:260] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77ba036678546e58c7cb1f4000ce255" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40651 } }
I20260619 04:39:43.800906 15423 raft_consensus.cc:388] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:43.801087 15423 raft_consensus.cc:482] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:43.801307 15423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:43.804140 15423 raft_consensus.cc:504] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77ba036678546e58c7cb1f4000ce255" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40651 } }
I20260619 04:39:43.804816 15423 leader_election.cc:302] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a77ba036678546e58c7cb1f4000ce255; no voters:
I20260619 04:39:43.805605 15423 leader_election.cc:288] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:43.805816 15428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:43.806748 15428 raft_consensus.cc:686] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [term 1 LEADER]: Becoming Leader. State: Replica: a77ba036678546e58c7cb1f4000ce255, State: Running, Role: LEADER
I20260619 04:39:43.807453 15428 consensus_queue.cc:237] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77ba036678546e58c7cb1f4000ce255" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40651 } }
I20260619 04:39:43.808403 15423 sys_catalog.cc:564] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:43.811054 15430 sys_catalog.cc:455] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a77ba036678546e58c7cb1f4000ce255. Latest consensus state: current_term: 1 leader_uuid: "a77ba036678546e58c7cb1f4000ce255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77ba036678546e58c7cb1f4000ce255" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40651 } } }
I20260619 04:39:43.811460 15430 sys_catalog.cc:458] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:43.812269 15429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a77ba036678546e58c7cb1f4000ce255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a77ba036678546e58c7cb1f4000ce255" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40651 } } }
I20260619 04:39:43.812688 15429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:43.815821 15434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:43.823693 15434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:43.835537 15434 catalog_manager.cc:1347] Generated new cluster ID: 0f33dcbfbb064ecb8e498bed46d461bf
I20260619 04:39:43.835692 15434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:43.868826 15434 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:43.870169 15434 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:43.881160 15434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a77ba036678546e58c7cb1f4000ce255: Generated new TSK 0
I20260619 04:39:43.882138 15434 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260619 04:39:43.925489 15453 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260619 04:39:43.925634 15453 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 04:39:43.926819 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:43.905678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.9.224.126:40651)
0619 04:39:43.905896 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:43.905906 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:43.906460 (+ 554us) server_negotiation.cc:407] Connection header received
0619 04:39:43.906935 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:43.906940 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:43.907017 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:43.907170 (+ 153us) server_negotiation.cc:226] Negotiated authn=JWT
0619 04:39:43.907781 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.908712 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.910858 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.911305 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.911409 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:43.912071 (+ 662us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 04:39:43.926205 (+ 14134us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0619 04:39:43.926588 (+ 383us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51752: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":68}
W20260619 04:39:43.926973 15426 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51752: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260619 04:39:43.927242 15452 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:43.905635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40651 (local address 127.0.0.1:51752)
0619 04:39:43.906346 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:43.906367 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:43.906544 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:43.907218 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:43.907224 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:43.907238 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0619 04:39:43.907569 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:43.907591 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.908849 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.908855 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:43.910683 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:43.910701 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:43.911492 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:43.911498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:43.911706 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:43.911768 (+ 62us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 04:39:43.926516 (+ 14748us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0619 04:39:43.926829 (+ 313us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.224.126:40651: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":379,"threads_started":1}
I20260619 04:39:43.928792 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15357
I20260619 04:39:43.930102 15418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:44.026475 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15357
2026-06-19T04:39:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (821 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260619 04:39:44.082890 10113 mini_oidc.cc:152] Starting JWKS server
I20260619 04:39:44.084798 10113 webserver.cc:460] Webserver started at https://127.0.0.1:35939/ using document root <none> and password file <none>
I20260619 04:39:44.085067 10113 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 04:39:44.085744 10113 webserver.cc:460] Webserver started at http://127.0.0.1:40785/ using document root <none> and password file <none>
2026-06-19T04:39:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:44Z Disabled control of system clock
I20260619 04:39:44.113931 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:43223
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:34437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:43223
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35939/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260619 04:39:44.446980 15460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:44.447321 15460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:44.447489 15460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:44.455014 15460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:44.455138 15460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:44.455236 15460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:44.455317 15460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:44.455384 15460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 04:39:44.455484 15460 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 04:39:44.455556 15460 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35939/jwks.json
I20260619 04:39:44.465324 15460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:34437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:43223
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:43223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35939/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:44.466753 15460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:44.468586 15460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:44.481045 15465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:44.480993 15468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:44.481015 15466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:44.482024 15460 server_base.cc:1034] running on GCE node
I20260619 04:39:44.482928 15460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:44.484486 15460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:44.485778 15460 hybrid_clock.cc:648] HybridClock initialized: now 1781843984485733 us; error 40 us; skew 500 ppm
I20260619 04:39:44.486279 15460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:44.489042 15460 webserver.cc:460] Webserver started at http://127.9.224.126:44545/ using document root <none> and password file <none>
I20260619 04:39:44.489850 15460 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:44.489997 15460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:44.490430 15460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:44.493569 15460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "a550607bf20947edb3360ed47371e75e"
format_stamp: "Formatted at 2026-06-19 04:39:44 on dist-test-slave-9dgf"
server_key: "2cdb9fe72e7aa7a5fbe8d8de7cd99582"
server_key_iv: "74dccbf8d969f7c3e75eb7c16bf2de0d"
server_key_version: "encryptionkey@0"
I20260619 04:39:44.494532 15460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "a550607bf20947edb3360ed47371e75e"
format_stamp: "Formatted at 2026-06-19 04:39:44 on dist-test-slave-9dgf"
server_key: "2cdb9fe72e7aa7a5fbe8d8de7cd99582"
server_key_iv: "74dccbf8d969f7c3e75eb7c16bf2de0d"
server_key_version: "encryptionkey@0"
I20260619 04:39:44.500200 15460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:39:44.503907 15474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:44.505375 15460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:39:44.505589 15460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "a550607bf20947edb3360ed47371e75e"
format_stamp: "Formatted at 2026-06-19 04:39:44 on dist-test-slave-9dgf"
server_key: "2cdb9fe72e7aa7a5fbe8d8de7cd99582"
server_key_iv: "74dccbf8d969f7c3e75eb7c16bf2de0d"
server_key_version: "encryptionkey@0"
I20260619 04:39:44.505833 15460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:44.525530 15460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:44.526477 15460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:44.526815 15460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:44.545250 15460 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:43223
I20260619 04:39:44.545269 15525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:43223 every 8 connection(s)
I20260619 04:39:44.546725 15460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:44.550619 15526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:44.553670 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15460
I20260619 04:39:44.553900 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:44.554590 10113 external_mini_cluster.cc:1428] Setting key 06f1b5cd04508d8fd1c2f2f456f3bfa8
I20260619 04:39:44.564620 15526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e: Bootstrap starting.
I20260619 04:39:44.568941 15526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:44.570194 15526 log.cc:824] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:44.572508 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:44.556648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.9.224.126:43223)
0619 04:39:44.557792 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:44.557806 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:44.557862 (+ 56us) server_negotiation.cc:407] Connection header received
0619 04:39:44.560407 (+ 2545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:44.560441 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:44.561143 (+ 702us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:44.561655 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:44.562460 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:44.564733 (+ 2273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:44.567344 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:44.568267 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:44.568414 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:44.569724 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:44.569732 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:44.569747 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:44.570415 (+ 668us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:44.570524 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:44.570551 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:44.570647 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:44.571078 (+ 431us) server_negotiation.cc:299] Negotiation successful
0619 04:39:44.571486 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":343,"threads_started":1}
I20260619 04:39:44.573704 15526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e: No bootstrap required, opened a new log
I20260619 04:39:44.576627 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:39:44.581755 15526 raft_consensus.cc:348] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a550607bf20947edb3360ed47371e75e" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43223 } }
I20260619 04:39:44.582113 15526 raft_consensus.cc:374] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:44.582242 15526 raft_consensus.cc:729] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a550607bf20947edb3360ed47371e75e, State: Initialized, Role: FOLLOWER
I20260619 04:39:44.582867 15526 consensus_queue.cc:260] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a550607bf20947edb3360ed47371e75e" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43223 } }
I20260619 04:39:44.583091 15526 raft_consensus.cc:388] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:44.583236 15526 raft_consensus.cc:482] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:44.583403 15526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:44.585618 15526 raft_consensus.cc:504] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a550607bf20947edb3360ed47371e75e" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43223 } }
I20260619 04:39:44.586167 15526 leader_election.cc:302] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a550607bf20947edb3360ed47371e75e; no voters:
I20260619 04:39:44.586841 15526 leader_election.cc:288] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:44.587024 15531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:44.588969 15526 sys_catalog.cc:564] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:44.589099 15531 raft_consensus.cc:686] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [term 1 LEADER]: Becoming Leader. State: Replica: a550607bf20947edb3360ed47371e75e, State: Running, Role: LEADER
I20260619 04:39:44.589689 15531 consensus_queue.cc:237] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a550607bf20947edb3360ed47371e75e" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43223 } }
I20260619 04:39:44.593050 15533 sys_catalog.cc:455] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a550607bf20947edb3360ed47371e75e. Latest consensus state: current_term: 1 leader_uuid: "a550607bf20947edb3360ed47371e75e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a550607bf20947edb3360ed47371e75e" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43223 } } }
I20260619 04:39:44.593029 15532 sys_catalog.cc:455] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a550607bf20947edb3360ed47371e75e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a550607bf20947edb3360ed47371e75e" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43223 } } }
I20260619 04:39:44.593457 15533 sys_catalog.cc:458] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:44.593542 15532 sys_catalog.cc:458] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:44.596130 15539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:44.601318 15539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:44.611264 15539 catalog_manager.cc:1347] Generated new cluster ID: 5fff617c4b974fd9b721b60eba051ebc
I20260619 04:39:44.611394 15539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:44.621462 15539 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:44.623369 15539 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:44.642704 15539 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a550607bf20947edb3360ed47371e75e: Generated new TSK 0
I20260619 04:39:44.643690 15539 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:39:44.669595 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:44.660751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41740 (local address 127.9.224.126:43223)
0619 04:39:44.660957 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:44.660964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:44.661426 (+ 462us) server_negotiation.cc:407] Connection header received
0619 04:39:44.661641 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:44.661647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:44.661766 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:44.661944 (+ 178us) server_negotiation.cc:226] Negotiated authn=JWT
0619 04:39:44.662562 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:44.663693 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:44.665088 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:44.665803 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:44.665932 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:44.666449 (+ 517us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 04:39:44.668911 (+ 2462us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35939/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0619 04:39:44.669270 (+ 359us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41740: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35939/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":67}
W20260619 04:39:44.669766 15529 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41740: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35939/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260619 04:39:44.671383 15555 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:44.660606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:43223 (local address 127.0.0.1:41740)
0619 04:39:44.661321 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:44.661337 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:44.661462 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:44.662025 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:44.662028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:44.662040 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0619 04:39:44.662407 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:44.662418 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:44.663863 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:44.663868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:44.664947 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:44.664959 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:44.665987 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:44.665991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:44.666117 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:44.666153 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 04:39:44.669143 (+ 2990us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35939/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0619 04:39:44.670925 (+ 1782us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.224.126:43223: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35939/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":1446,"thread_start_us":355,"threads_started":1}
I20260619 04:39:44.673334 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15460
I20260619 04:39:44.674703 15521 generic_service.cc:196] Checking for leaks (request via RPC)
E20260619 04:39:44.681003 15556 webserver.cc:533] Webserver: sslize failed:
E20260619 04:39:44.681125 15556 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 04:39:44.773842 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15460
2026-06-19T04:39:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (747 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-06-19T04:39:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:44Z Disabled control of system clock
I20260619 04:39:44.859897 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40073
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:41893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:40073
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/testchainca.cert with env {}
W20260619 04:39:45.203712 15561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:45.204053 15561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:45.204243 15561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:45.211892 15561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:45.212023 15561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:45.212133 15561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:45.212239 15561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:45.212319 15561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 04:39:45.212437 15561 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 04:39:45.212512 15561 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260619 04:39:45.223412 15561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:40073
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:45.224833 15561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:45.226214 15561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:45.239594 15566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:45.239547 15567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:45.239897 15569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:45.240480 15561 server_base.cc:1034] running on GCE node
I20260619 04:39:45.241305 15561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:45.242892 15561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:45.244165 15561 hybrid_clock.cc:648] HybridClock initialized: now 1781843985244064 us; error 63 us; skew 500 ppm
I20260619 04:39:45.244590 15561 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:39:45.247215 15561 webserver.cc:460] Webserver started at http://127.9.224.126:37833/ using document root <none> and password file <none>
I20260619 04:39:45.247998 15561 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:45.248097 15561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:45.248466 15561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:45.251757 15561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "057ff7c08d9b48d1a0473d5d20afc11b"
format_stamp: "Formatted at 2026-06-19 04:39:45 on dist-test-slave-9dgf"
server_key: "fd66c0a6b9d03cd5180bbe5719c5145b"
server_key_iv: "bf50767e993c84bc7473a5c88991ca87"
server_key_version: "encryptionkey@0"
I20260619 04:39:45.252662 15561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "057ff7c08d9b48d1a0473d5d20afc11b"
format_stamp: "Formatted at 2026-06-19 04:39:45 on dist-test-slave-9dgf"
server_key: "fd66c0a6b9d03cd5180bbe5719c5145b"
server_key_iv: "bf50767e993c84bc7473a5c88991ca87"
server_key_version: "encryptionkey@0"
I20260619 04:39:45.258605 15561 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260619 04:39:45.262728 15575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:45.264330 15561 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:45.264550 15561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "057ff7c08d9b48d1a0473d5d20afc11b"
format_stamp: "Formatted at 2026-06-19 04:39:45 on dist-test-slave-9dgf"
server_key: "fd66c0a6b9d03cd5180bbe5719c5145b"
server_key_iv: "bf50767e993c84bc7473a5c88991ca87"
server_key_version: "encryptionkey@0"
I20260619 04:39:45.264807 15561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:45.293112 15561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:45.294135 15561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:45.294466 15561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:45.313130 15561 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:40073
I20260619 04:39:45.313163 15626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:40073 every 8 connection(s)
I20260619 04:39:45.314540 15561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:45.318465 15627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:45.321735 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15561
I20260619 04:39:45.321933 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:45.322798 10113 external_mini_cluster.cc:1428] Setting key d74cea8c93fa16ff3221947d33ef3e71
I20260619 04:39:45.331779 15627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b: Bootstrap starting.
I20260619 04:39:45.335587 15627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:45.336809 15627 log.cc:824] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:45.337498 15630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:45.324968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43906 (local address 127.9.224.126:40073)
0619 04:39:45.326046 (+ 1078us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:45.326058 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:45.326105 (+ 47us) server_negotiation.cc:407] Connection header received
0619 04:39:45.327779 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:45.327801 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:45.328287 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:45.328639 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:45.329229 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:45.330642 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:45.332510 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:45.333181 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:45.333335 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:45.334748 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:45.334756 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:45.334769 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:39:45.335329 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:45.335422 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:39:45.335445 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:45.335535 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:45.335877 (+ 342us) server_negotiation.cc:299] Negotiation successful
0619 04:39:45.336310 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":425,"threads_started":1}
I20260619 04:39:45.340428 15627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b: No bootstrap required, opened a new log
I20260619 04:39:45.342015 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:39:45.348853 15627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40073 } }
I20260619 04:39:45.349298 15627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:45.349407 15627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057ff7c08d9b48d1a0473d5d20afc11b, State: Initialized, Role: FOLLOWER
I20260619 04:39:45.350029 15627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40073 } }
I20260619 04:39:45.350315 15627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:45.350458 15627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:45.350647 15627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:45.353549 15627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40073 } }
I20260619 04:39:45.354202 15627 leader_election.cc:302] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 057ff7c08d9b48d1a0473d5d20afc11b; no voters:
I20260619 04:39:45.354893 15627 leader_election.cc:288] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:45.355126 15632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:45.355975 15632 raft_consensus.cc:686] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [term 1 LEADER]: Becoming Leader. State: Replica: 057ff7c08d9b48d1a0473d5d20afc11b, State: Running, Role: LEADER
I20260619 04:39:45.356504 15632 consensus_queue.cc:237] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40073 } }
I20260619 04:39:45.357328 15627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:45.359341 15634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 057ff7c08d9b48d1a0473d5d20afc11b. Latest consensus state: current_term: 1 leader_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40073 } } }
I20260619 04:39:45.360230 15634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:45.360229 15633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "057ff7c08d9b48d1a0473d5d20afc11b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40073 } } }
I20260619 04:39:45.360962 15633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:45.362465 15637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:45.366765 15637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:45.376425 15637 catalog_manager.cc:1347] Generated new cluster ID: ab74b483bc47434ab71de30b597c492b
I20260619 04:39:45.376570 15637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:45.385344 15637 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:45.386783 15637 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:45.395129 15637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 057ff7c08d9b48d1a0473d5d20afc11b: Generated new TSK 0
I20260619 04:39:45.396056 15637 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:39:45.481974 15630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:45.414668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43920 (local address 127.9.224.126:40073)
0619 04:39:45.414923 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:45.414933 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:45.415387 (+ 454us) server_negotiation.cc:407] Connection header received
0619 04:39:45.415615 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:45.415622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:45.415693 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:45.415863 (+ 170us) server_negotiation.cc:226] Negotiated authn=JWT
0619 04:39:45.416421 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:45.417150 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:45.419298 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:45.419771 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:45.419874 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:45.420449 (+ 575us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 04:39:45.481360 (+ 60911us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0619 04:39:45.481690 (+ 330us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43920: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":82}
W20260619 04:39:45.482141 15630 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43920: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260619 04:39:45.482511 15656 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:45.414624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40073 (local address 127.0.0.1:43920)
0619 04:39:45.415267 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:45.415290 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:45.415456 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:45.415912 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:45.415917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:45.415931 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0619 04:39:45.416252 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:45.416267 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:45.417296 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:45.417302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:45.419145 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:45.419162 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:45.419953 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:45.419959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:45.420149 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:45.420199 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 04:39:45.481715 (+ 61516us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0619 04:39:45.482052 (+ 337us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.224.126:40073: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":342,"threads_started":1}
I20260619 04:39:45.483913 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15561
I20260619 04:39:45.485137 15622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:45.583503 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15561
2026-06-19T04:39:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (788 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (423 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (418 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:46 dist-test-slave-9dgf krb5kdc[15671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:46 dist-test-slave-9dgf krb5kdc[15671](info): set up 2 sockets
Jun 19 04:39:46 dist-test-slave-9dgf krb5kdc[15671](info): commencing operation
krb5kdc: starting...
W20260619 04:39:47.522876 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:47 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:39:47.745837 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36329
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:48.081888 15684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:48.082198 15684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:48.082355 15684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:48.089766 15684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:48.089892 15684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:48.089938 15684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:48.089996 15684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:48.090039 15684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:48.100180 15684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:48.101526 15684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:48.102821 15684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:48.114630 15690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:48.114723 15689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:48.114691 15692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:48.115585 15684 server_base.cc:1034] running on GCE node
I20260619 04:39:48.116520 15684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:48.117996 15684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:48.119228 15684 hybrid_clock.cc:648] HybridClock initialized: now 1781843988119153 us; error 67 us; skew 500 ppm
I20260619 04:39:48.119640 15684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:48 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843988, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:48.122991 15684 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:39:48.124608 15684 webserver.cc:460] Webserver started at http://127.9.224.126:39099/ using document root <none> and password file <none>
I20260619 04:39:48.125327 15684 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:48.125481 15684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:48.125797 15684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:48.128937 15684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "28ffdd9fcb964202b441eb8e5d121674"
format_stamp: "Formatted at 2026-06-19 04:39:48 on dist-test-slave-9dgf"
server_key: "21d353b5dd17643977b4fc22dc5f0b80"
server_key_iv: "71b7ca5ceb209d69c776c08b2289d41e"
server_key_version: "encryptionkey@0"
I20260619 04:39:48.129742 15684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "28ffdd9fcb964202b441eb8e5d121674"
format_stamp: "Formatted at 2026-06-19 04:39:48 on dist-test-slave-9dgf"
server_key: "21d353b5dd17643977b4fc22dc5f0b80"
server_key_iv: "71b7ca5ceb209d69c776c08b2289d41e"
server_key_version: "encryptionkey@0"
I20260619 04:39:48.135144 15684 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 04:39:48.138641 15699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:48.139948 15684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:39:48.140125 15684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "28ffdd9fcb964202b441eb8e5d121674"
format_stamp: "Formatted at 2026-06-19 04:39:48 on dist-test-slave-9dgf"
server_key: "21d353b5dd17643977b4fc22dc5f0b80"
server_key_iv: "71b7ca5ceb209d69c776c08b2289d41e"
server_key_version: "encryptionkey@0"
I20260619 04:39:48.140328 15684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:48.160172 15684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:48.164798 15684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:48.165102 15684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:48.183422 15684 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36329
I20260619 04:39:48.183445 15750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36329 every 8 connection(s)
I20260619 04:39:48.184823 15684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:48.187578 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15684
I20260619 04:39:48.187783 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:48.188406 10113 external_mini_cluster.cc:1428] Setting key 0bf9799ff73d4e135d9ed608f67521aa
I20260619 04:39:48.188782 15751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:48.203085 15751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674: Bootstrap starting.
Jun 19 04:39:48 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:48.207193 15751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:48.208555 15751 log.cc:824] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:48.212174 15751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674: No bootstrap required, opened a new log
I20260619 04:39:48.213634 15754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:48.190401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46682 (local address 127.9.224.126:36329)
0619 04:39:48.191226 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:48.191243 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:48.191293 (+ 50us) server_negotiation.cc:407] Connection header received
0619 04:39:48.193697 (+ 2404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:48.193729 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:48.194305 (+ 576us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:48.194800 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:48.196137 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:48.198094 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:48.199390 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:48.200535 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:48.200725 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:48.204808 (+ 4083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:48.204820 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:48.204841 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:48.204886 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:48.208862 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:48.209814 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:48.209820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:48.209828 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:48.210038 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:48.210456 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:48.210460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:48.210463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:48.211167 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:48.211464 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:48.211806 (+ 342us) server_negotiation.cc:299] Negotiation successful
0619 04:39:48.212239 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":329,"threads_started":1}
I20260619 04:39:48.220862 15751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ffdd9fcb964202b441eb8e5d121674" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36329 } }
I20260619 04:39:48.221351 15751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:48.221486 15751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ffdd9fcb964202b441eb8e5d121674, State: Initialized, Role: FOLLOWER
I20260619 04:39:48.222177 15751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ffdd9fcb964202b441eb8e5d121674" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36329 } }
I20260619 04:39:48.222468 15751 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:48.222615 15751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:48.222792 15751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:48.224985 15751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ffdd9fcb964202b441eb8e5d121674" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36329 } }
I20260619 04:39:48.225620 15751 leader_election.cc:302] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28ffdd9fcb964202b441eb8e5d121674; no voters:
I20260619 04:39:48.226383 15751 leader_election.cc:288] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:48.226511 15756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:48.227217 15756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [term 1 LEADER]: Becoming Leader. State: Replica: 28ffdd9fcb964202b441eb8e5d121674, State: Running, Role: LEADER
I20260619 04:39:48.227757 15756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ffdd9fcb964202b441eb8e5d121674" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36329 } }
I20260619 04:39:48.228538 15751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:48.230747 15758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28ffdd9fcb964202b441eb8e5d121674. Latest consensus state: current_term: 1 leader_uuid: "28ffdd9fcb964202b441eb8e5d121674" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ffdd9fcb964202b441eb8e5d121674" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36329 } } }
I20260619 04:39:48.231138 15758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:48.231985 15757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28ffdd9fcb964202b441eb8e5d121674" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28ffdd9fcb964202b441eb8e5d121674" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36329 } } }
I20260619 04:39:48.232395 15757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:48.233709 15763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:48.239089 15763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:48.248150 15763 catalog_manager.cc:1347] Generated new cluster ID: 9f3903da8178414cae0cdbd723360770
I20260619 04:39:48.248276 15763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:48.281993 15763 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:48.283381 15763 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:48.299399 15763 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28ffdd9fcb964202b441eb8e5d121674: Generated new TSK 0
I20260619 04:39:48.300278 15763 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:39:48.353775 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36329
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:48.691079 15777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:48.691401 15777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:48.691561 15777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:48.699518 15777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:48.699647 15777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:48.699844 15777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:48.709906 15777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:48.711323 15777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:48.712641 15777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:48.727514 15783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:48.727487 15785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:48.727454 15782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:48.728485 15777 server_base.cc:1034] running on GCE node
I20260619 04:39:48.729252 15777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:48.730451 15777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:48.731909 15777 hybrid_clock.cc:648] HybridClock initialized: now 1781843988731648 us; error 47 us; skew 500 ppm
I20260619 04:39:48.732286 15777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:48 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843988, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:48.740311 15777 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:39:48.742419 15777 webserver.cc:460] Webserver started at http://127.9.224.65:43267/ using document root <none> and password file <none>
I20260619 04:39:48.743510 15777 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:48.743743 15777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:48.744200 15777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:48.747961 15777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "13b1131d3a454ad0b5281cfee2e2ec7a"
format_stamp: "Formatted at 2026-06-19 04:39:48 on dist-test-slave-9dgf"
server_key: "f9af0f65a48c66727559e72389d44abf"
server_key_iv: "2e5ed1edab625c3fa63972525795de4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:48.748728 15777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "13b1131d3a454ad0b5281cfee2e2ec7a"
format_stamp: "Formatted at 2026-06-19 04:39:48 on dist-test-slave-9dgf"
server_key: "f9af0f65a48c66727559e72389d44abf"
server_key_iv: "2e5ed1edab625c3fa63972525795de4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:48.754202 15777 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:39:48.758113 15792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:48.759615 15777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 04:39:48.759795 15777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "13b1131d3a454ad0b5281cfee2e2ec7a"
format_stamp: "Formatted at 2026-06-19 04:39:48 on dist-test-slave-9dgf"
server_key: "f9af0f65a48c66727559e72389d44abf"
server_key_iv: "2e5ed1edab625c3fa63972525795de4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:48.759990 15777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:48.781150 15777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:48.785697 15777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:48.786005 15777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:48.787104 15777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:48.788566 15777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:48.788667 15777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:48.788812 15777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:48.788861 15777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:48.824244 15777 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:45569
I20260619 04:39:48.824290 15904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:45569 every 8 connection(s)
I20260619 04:39:48.825604 15777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:48.835201 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15777
I20260619 04:39:48.835407 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:48.836043 10113 external_mini_cluster.cc:1428] Setting key d385254f8ea64c585f73cd09a3fe6095
Jun 19 04:39:48 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843988, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:48.847710 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:48.828250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:33111 (local address 127.9.224.126:36329)
0619 04:39:48.828866 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:48.828872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:48.829950 (+ 1078us) server_negotiation.cc:407] Connection header received
0619 04:39:48.831917 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:48.831921 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:48.831989 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:48.832092 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:48.833886 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:48.834775 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:48.836730 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:48.837222 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:48.837384 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:48.840869 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:48.840878 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:48.840885 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:48.840931 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:48.844445 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:48.845334 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:48.845342 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:48.845345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:48.845476 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:48.845902 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:48.845907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:48.845911 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:48.846176 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:48.846360 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:48.847093 (+ 733us) server_negotiation.cc:299] Negotiation successful
0619 04:39:48.847333 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":486,"thread_start_us":261,"threads_started":1}
I20260619 04:39:48.848737 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:48.828888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36329 (local address 127.9.224.65:33111)
0619 04:39:48.829744 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:48.829814 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:48.831628 (+ 1814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:48.832361 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:48.832370 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:48.832893 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:48.833617 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:48.833636 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:48.835016 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:48.835026 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:48.836569 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:48.836581 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:48.837432 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:48.837437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:48.837644 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:48.838439 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:48.838465 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:48.840644 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:48.844596 (+ 3952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:48.844606 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:48.844624 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:48.845214 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:48.845595 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:48.845600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:48.845604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:48.845786 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:48.846332 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:48.846340 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:48.846706 (+ 366us) client_negotiation.cc:769] Sending connection context
0619 04:39:48.846994 (+ 288us) client_negotiation.cc:240] Negotiation successful
0619 04:39:48.847550 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":339,"threads_started":1}
I20260619 04:39:48.850564 15905 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36329
I20260619 04:39:48.850924 15905 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:48.851827 15905 heartbeater.cc:511] Master 127.9.224.126:36329 requested a full tablet report, sending...
I20260619 04:39:48.854840 15716 ts_manager.cc:194] Registered new tserver with Master: 13b1131d3a454ad0b5281cfee2e2ec7a (127.9.224.65:45569)
I20260619 04:39:48.857124 15716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:33111
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:39:48.886451 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36329
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:49.220800 15911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:49.221129 15911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:49.221294 15911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:49.228856 15911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:49.229009 15911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:49.229183 15911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:49.239821 15911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:49.241235 15911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:49.242682 15911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:49.256413 15917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:49.256350 15919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:49.256512 15916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:49.257459 15911 server_base.cc:1034] running on GCE node
I20260619 04:39:49.258051 15911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:49.259003 15911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:49.260223 15911 hybrid_clock.cc:648] HybridClock initialized: now 1781843989260163 us; error 44 us; skew 500 ppm
I20260619 04:39:49.260533 15911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.263851 15911 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:39:49.265332 15911 webserver.cc:460] Webserver started at http://127.9.224.66:34875/ using document root <none> and password file <none>
I20260619 04:39:49.265982 15911 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:49.266084 15911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:49.266407 15911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:49.269447 15911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "340c00623d1b408fb740acf7760e3e00"
format_stamp: "Formatted at 2026-06-19 04:39:49 on dist-test-slave-9dgf"
server_key: "659f27a4d04d1345e5aca14d5715b002"
server_key_iv: "237a980e54800e35bb7b6ec9eb8f8be5"
server_key_version: "encryptionkey@0"
I20260619 04:39:49.270190 15911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "340c00623d1b408fb740acf7760e3e00"
format_stamp: "Formatted at 2026-06-19 04:39:49 on dist-test-slave-9dgf"
server_key: "659f27a4d04d1345e5aca14d5715b002"
server_key_iv: "237a980e54800e35bb7b6ec9eb8f8be5"
server_key_version: "encryptionkey@0"
I20260619 04:39:49.275522 15911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:39:49.279279 15926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:49.280726 15911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:49.280874 15911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "340c00623d1b408fb740acf7760e3e00"
format_stamp: "Formatted at 2026-06-19 04:39:49 on dist-test-slave-9dgf"
server_key: "659f27a4d04d1345e5aca14d5715b002"
server_key_iv: "237a980e54800e35bb7b6ec9eb8f8be5"
server_key_version: "encryptionkey@0"
I20260619 04:39:49.281055 15911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:49.297714 15911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:49.302287 15911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:49.302552 15911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:49.303481 15911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:49.304842 15911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:49.304917 15911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:49.305066 15911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:49.305130 15911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:49.337800 15911 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:42083
I20260619 04:39:49.337836 16038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:42083 every 8 connection(s)
I20260619 04:39:49.339151 15911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:49.347352 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 15911
I20260619 04:39:49.347532 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:49.348068 10113 external_mini_cluster.cc:1428] Setting key 4fb50d8efa67396fcf868b677d3f9a28
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:49.360821 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.341679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:52253 (local address 127.9.224.126:36329)
0619 04:39:49.341906 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.341912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.343141 (+ 1229us) server_negotiation.cc:407] Connection header received
0619 04:39:49.345136 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.345140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.345212 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.345303 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.346892 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.347997 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.350071 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.350736 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.350889 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.354279 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:49.354288 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:49.354296 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:49.354352 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:49.357514 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.358525 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.358528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.358531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.358654 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.359136 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.359139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.359141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.359397 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:49.359504 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:49.360407 (+ 903us) server_negotiation.cc:299] Negotiation successful
0619 04:39:49.360583 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 04:39:49.362507 16041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.342179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36329 (local address 127.9.224.66:52253)
0619 04:39:49.342967 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:49.343030 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:49.344861 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:49.345559 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:49.345567 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:49.346084 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:49.346731 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:49.346749 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.348186 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.348195 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:49.349922 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:49.349938 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.350952 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.350958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:49.351167 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.351857 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:49.351881 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:49.354012 (+ 2131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:49.357664 (+ 3652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:49.357678 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:49.357700 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:49.358415 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:49.358759 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:49.358767 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:49.358773 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:49.359028 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:49.359522 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:49.359534 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:49.360005 (+ 471us) client_negotiation.cc:769] Sending connection context
0619 04:39:49.360307 (+ 302us) client_negotiation.cc:240] Negotiation successful
0619 04:39:49.360925 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":299,"threads_started":1}
I20260619 04:39:49.364146 16039 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36329
I20260619 04:39:49.364493 16039 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:49.365355 16039 heartbeater.cc:511] Master 127.9.224.126:36329 requested a full tablet report, sending...
I20260619 04:39:49.366998 15716 ts_manager.cc:194] Registered new tserver with Master: 340c00623d1b408fb740acf7760e3e00 (127.9.224.66:42083)
I20260619 04:39:49.367808 15716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:52253
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:39:49.396981 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36329
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:49.734050 16044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:49.734493 16044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:49.734661 16044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:49.742412 16044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:49.742558 16044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:49.742731 16044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:49.752872 16044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:49.754302 16044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:49.755882 16044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:49.769394 16049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:49.769425 16052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:49.769455 16050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:49.770534 16044 server_base.cc:1034] running on GCE node
I20260619 04:39:49.771216 16044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:49.772223 16044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:49.773449 16044 hybrid_clock.cc:648] HybridClock initialized: now 1781843989773400 us; error 51 us; skew 500 ppm
I20260619 04:39:49.773773 16044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.776997 16044 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:39:49.778574 16044 webserver.cc:460] Webserver started at http://127.9.224.67:33353/ using document root <none> and password file <none>
I20260619 04:39:49.779287 16044 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:49.779431 16044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:49.779732 16044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:49.782800 16044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "c2ff6ec9cba0428688bd28cb71ffd12f"
format_stamp: "Formatted at 2026-06-19 04:39:49 on dist-test-slave-9dgf"
server_key: "d45918ed6818a4905183847c6fce95da"
server_key_iv: "1a5badedc0ec5be4c6f7ef6edecb96a3"
server_key_version: "encryptionkey@0"
I20260619 04:39:49.783633 16044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "c2ff6ec9cba0428688bd28cb71ffd12f"
format_stamp: "Formatted at 2026-06-19 04:39:49 on dist-test-slave-9dgf"
server_key: "d45918ed6818a4905183847c6fce95da"
server_key_iv: "1a5badedc0ec5be4c6f7ef6edecb96a3"
server_key_version: "encryptionkey@0"
I20260619 04:39:49.789378 16044 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:39:49.792984 16059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:49.794447 16044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:49.794625 16044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "c2ff6ec9cba0428688bd28cb71ffd12f"
format_stamp: "Formatted at 2026-06-19 04:39:49 on dist-test-slave-9dgf"
server_key: "d45918ed6818a4905183847c6fce95da"
server_key_iv: "1a5badedc0ec5be4c6f7ef6edecb96a3"
server_key_version: "encryptionkey@0"
I20260619 04:39:49.794850 16044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:49.815418 16044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:49.819896 16044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:49.820209 16044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:49.821544 16044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:49.823673 16044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:49.823904 16044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 04:39:49.824072 16044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:49.824154 16044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:49.860682 15905 heartbeater.cc:503] Master 127.9.224.126:36329 was elected leader, sending a full tablet report...
I20260619 04:39:49.862039 16044 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33427
I20260619 04:39:49.862071 16171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33427 every 8 connection(s)
I20260619 04:39:49.863731 16044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:49.867980 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16044
I20260619 04:39:49.868156 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:49.868609 10113 external_mini_cluster.cc:1428] Setting key fe7332c742328eba7ba9ae5645e4bff0
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:39:49.884366 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.866472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:41071 (local address 127.9.224.126:36329)
0619 04:39:49.866917 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.866921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.867939 (+ 1018us) server_negotiation.cc:407] Connection header received
0619 04:39:49.870107 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.870113 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.870207 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.870365 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.872192 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.873009 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.874648 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.875050 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.875182 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.878643 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:49.878648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:49.878652 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:49.878686 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:49.881125 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.881821 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.881824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.881827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.881987 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.882458 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.882463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.882465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.882732 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:49.882908 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:49.883701 (+ 793us) server_negotiation.cc:299] Negotiation successful
0619 04:39:49.883941 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":245,"threads_started":1}
I20260619 04:39:49.885538 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.867034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36329 (local address 127.9.224.67:41071)
0619 04:39:49.867778 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:49.867823 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:49.869777 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:49.870621 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:49.870630 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:49.871404 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:49.872029 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:49.872047 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.873160 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.873165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:49.874502 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:49.874514 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.875280 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.875286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:49.875527 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.876178 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:49.876205 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:49.878435 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:49.881264 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:49.881271 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:49.881284 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:49.881711 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:49.882091 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:49.882094 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:49.882096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:49.882332 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:49.882892 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:49.882898 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:49.883324 (+ 426us) client_negotiation.cc:769] Sending connection context
0619 04:39:49.883608 (+ 284us) client_negotiation.cc:240] Negotiation successful
0619 04:39:49.884207 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":296,"threads_started":1}
I20260619 04:39:49.886924 16172 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36329
I20260619 04:39:49.887265 16172 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:49.888016 16172 heartbeater.cc:511] Master 127.9.224.126:36329 requested a full tablet report, sending...
I20260619 04:39:49.889461 15716 ts_manager.cc:194] Registered new tserver with Master: c2ff6ec9cba0428688bd28cb71ffd12f (127.9.224.67:33427)
I20260619 04:39:49.890350 15716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:41071
I20260619 04:39:49.896555 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/test-admin.keytab.
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.923828 10113 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260619 04:39:49.929354 16180 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:49.926648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38310 (local address 127.9.224.65:45569)
0619 04:39:49.927436 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.927444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.927471 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:39:49.927531 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.927538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.927753 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.927895 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.928829 (+ 934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38310: BlockingRecv error: recv got EOF from 127.0.0.1:38310 (error 108)
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":506,"threads_started":1}
W20260619 04:39:49.929505 10113 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc' of type FILE
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.931203 10113 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.932622 10113 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:49.949203 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.934505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38318 (local address 127.9.224.65:45569)
0619 04:39:49.934740 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.934749 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.934983 (+ 234us) server_negotiation.cc:407] Connection header received
0619 04:39:49.935212 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.935216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.935278 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.935379 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.936380 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.937355 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.938667 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.939240 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.939392 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.943045 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:49.943059 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:49.943075 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:49.943111 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:49.946187 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.947006 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.947014 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.947017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.947149 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.947576 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.947580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.947582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.947952 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:49.948195 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:49.948602 (+ 407us) server_negotiation.cc:299] Negotiation successful
0619 04:39:49.948919 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260619 04:39:49.955472 16180 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:49.953653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.9.224.65:45569)
0619 04:39:49.953862 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.953869 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.954050 (+ 181us) server_negotiation.cc:407] Connection header received
0619 04:39:49.954264 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.954269 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.954337 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.954436 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.955218 (+ 782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38328: BlockingRecv error: recv got EOF from 127.0.0.1:38328 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260619 04:39:49.955790 10113 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc' of type FILE
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.957468 10113 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.958863 10113 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:49.973722 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.960188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38344 (local address 127.9.224.65:45569)
0619 04:39:49.960441 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.960447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.960654 (+ 207us) server_negotiation.cc:407] Connection header received
0619 04:39:49.960864 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.960870 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.960940 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.961039 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.961977 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.962786 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.964106 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.964639 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.964765 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.968486 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:49.968491 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:49.968495 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:49.968539 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:49.971172 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.971833 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.971840 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.971844 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.971997 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.972377 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.972382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.972389 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.972658 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:49.972925 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:49.973212 (+ 287us) server_negotiation.cc:299] Negotiation successful
0619 04:39:49.973443 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
W20260619 04:39:49.978127 16180 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:39:49.976325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38350 (local address 127.9.224.65:45569)
0619 04:39:49.976512 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.976520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.976782 (+ 262us) server_negotiation.cc:407] Connection header received
0619 04:39:49.976973 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.976977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.977045 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.977140 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.977862 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38350: BlockingRecv error: recv got EOF from 127.0.0.1:38350 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260619 04:39:49.978394 10113 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781843940819459-10113-0/krb5kdc/krb5cc' of type FILE
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.980006 10113 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:49.981376 10113 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 04:39:49 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:39:49.995994 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.982941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.9.224.65:45569)
0619 04:39:49.983168 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.983175 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.983428 (+ 253us) server_negotiation.cc:407] Connection header received
0619 04:39:49.983624 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.983629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.983688 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.983787 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:49.984874 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.985650 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.986942 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:49.987356 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:49.987487 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:49.991142 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:49.991148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:49.991151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:49.991186 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:49.993636 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.994301 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.994305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.994308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.994456 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:49.994771 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:49.994774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:49.994776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:49.995040 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:49.995263 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:49.995468 (+ 205us) server_negotiation.cc:299] Negotiation successful
0619 04:39:49.995666 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:39:49.997468 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15777
I20260619 04:39:50.009449 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:49.998096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38368 (local address 127.9.224.65:45569)
0619 04:39:49.998291 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:49.998298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:49.998650 (+ 352us) server_negotiation.cc:407] Connection header received
0619 04:39:49.998838 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:49.998851 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:49.998923 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:49.999018 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:50.000019 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:50.000702 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:50.001863 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:50.002367 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:50.002491 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:50.004447 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:50.004453 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:50.004458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:50.004500 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:50.006924 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:50.007562 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:50.007568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:50.007572 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:50.007719 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:50.008070 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:50.008075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:50.008079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:50.008341 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:50.008611 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:50.008923 (+ 312us) server_negotiation.cc:299] Negotiation successful
0619 04:39:50.009134 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260619 04:39:50.010023 15900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:50.095178 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15777
I20260619 04:39:50.111370 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15911
Jun 19 04:39:50 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:39:50.127437 16193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:50.112271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40440 (local address 127.9.224.66:42083)
0619 04:39:50.112875 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:50.112884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:50.112916 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:39:50.112987 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:50.112996 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:50.113291 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:50.113490 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:50.114599 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:50.115764 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:50.117001 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:50.117605 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:50.117746 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:50.121679 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:50.121690 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:50.121706 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:50.121742 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:50.124825 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:50.125518 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:50.125525 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:50.125528 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:50.125647 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:50.125982 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:50.125986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:50.125988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:50.126427 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:50.126648 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:50.126928 (+ 280us) server_negotiation.cc:299] Negotiation successful
0619 04:39:50.127122 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":275,"threads_started":1}
I20260619 04:39:50.128712 16034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:50.211743 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15911
I20260619 04:39:50.227850 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16044
Jun 19 04:39:50 dist-test-slave-9dgf krb5kdc[15671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:39:50.243661 16195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:50.229020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41736 (local address 127.9.224.67:33427)
0619 04:39:50.229647 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:50.229654 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:50.229683 (+ 29us) server_negotiation.cc:407] Connection header received
0619 04:39:50.229746 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:50.229752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:50.230015 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:50.230165 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:50.231246 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:50.232239 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:50.233458 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:50.234009 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:50.234105 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:50.238060 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:50.238073 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:50.238089 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:50.238126 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:50.240911 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:50.241582 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:50.241589 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:50.241592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:50.241722 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:50.242077 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:50.242080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:50.242082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:50.242519 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:50.242762 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:50.243049 (+ 287us) server_negotiation.cc:299] Negotiation successful
0619 04:39:50.243342 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":327,"threads_started":1}
I20260619 04:39:50.245126 16167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:50.327870 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16044
I20260619 04:39:50.343906 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 15684
I20260619 04:39:50.345281 15746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:50.448069 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 15684
2026-06-19T04:39:50Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4027 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:39:50 dist-test-slave-9dgf krb5kdc[16200](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:39:50 dist-test-slave-9dgf krb5kdc[16200](info): set up 2 sockets
Jun 19 04:39:50 dist-test-slave-9dgf krb5kdc[16200](info): commencing operation
krb5kdc: starting...
W20260619 04:39:51.571084 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:39:51 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:39:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:39:51Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab.
Entry for principal oryx/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab.
I20260619 04:39:51.798372 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36341
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab
--principal=oryx/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:52.136622 16213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:52.136992 16213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:52.137149 16213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:52.144737 16213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:52.144899 16213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:52.145022 16213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:52.145120 16213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:52.145207 16213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:52.155542 16213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab
--principal=oryx/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:52.156991 16213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:52.158420 16213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:52.170578 16218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:52.170858 16219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:52.170827 16221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:52.171636 16213 server_base.cc:1034] running on GCE node
I20260619 04:39:52.172484 16213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:52.174178 16213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:52.175475 16213 hybrid_clock.cc:648] HybridClock initialized: now 1781843992175429 us; error 46 us; skew 500 ppm
I20260619 04:39:52.175889 16213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:52 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843992, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:52.179237 16213 init.cc:377] Logged in from keytab as oryx/127.9.224.126@KRBTEST.COM (short username oryx)
I20260619 04:39:52.180868 16213 webserver.cc:460] Webserver started at http://127.9.224.126:35229/ using document root <none> and password file <none>
I20260619 04:39:52.181581 16213 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:52.181730 16213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:52.182034 16213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:52.185170 16213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "1109aa8588fb4702833e5d1cb37c5a84"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "2ff3c61baed0217a909f2b3e8a616e8e"
server_key_iv: "4ee94ee2961cb9c28886766ffc7bd86f"
server_key_version: "encryptionkey@0"
I20260619 04:39:52.185974 16213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "1109aa8588fb4702833e5d1cb37c5a84"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "2ff3c61baed0217a909f2b3e8a616e8e"
server_key_iv: "4ee94ee2961cb9c28886766ffc7bd86f"
server_key_version: "encryptionkey@0"
I20260619 04:39:52.191687 16213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:39:52.195530 16228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:52.196977 16213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:52.197227 16213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "1109aa8588fb4702833e5d1cb37c5a84"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "2ff3c61baed0217a909f2b3e8a616e8e"
server_key_iv: "4ee94ee2961cb9c28886766ffc7bd86f"
server_key_version: "encryptionkey@0"
I20260619 04:39:52.197444 16213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:52.222801 16213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:52.227226 16213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:52.227543 16213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:52.248543 16213 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36341
I20260619 04:39:52.248555 16279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36341 every 8 connection(s)
I20260619 04:39:52.250137 16213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:39:52.250590 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16213
I20260619 04:39:52.250798 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:39:52.251719 10113 external_mini_cluster.cc:1428] Setting key 05d9ec3184fa0b50bab50114a04b44a4
I20260619 04:39:52.255277 16280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 04:39:52 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:52.268819 16280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Bootstrap starting.
I20260619 04:39:52.273819 16280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:52.275332 16280 log.cc:824] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:52.278950 16280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: No bootstrap required, opened a new log
I20260619 04:39:52.279268 16283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:52.254306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38140 (local address 127.9.224.126:36341)
0619 04:39:52.255669 (+ 1363us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:52.255686 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:52.255741 (+ 55us) server_negotiation.cc:407] Connection header received
0619 04:39:52.258158 (+ 2417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:52.258188 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:52.258779 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:52.259260 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:52.260654 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:52.262751 (+ 2097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:52.264021 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:52.265159 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:52.265369 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:52.269465 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:52.269477 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:52.269498 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:52.269546 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:52.274394 (+ 4848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:52.275360 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:52.275371 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:52.275380 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:52.275609 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:52.276095 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:52.276101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:52.276105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:52.276756 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:52.277153 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:52.277602 (+ 449us) server_negotiation.cc:299] Negotiation successful
0619 04:39:52.278079 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1094,"thread_start_us":834,"threads_started":1}
I20260619 04:39:52.287765 16280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } }
I20260619 04:39:52.288199 16280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:52.288314 16280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1109aa8588fb4702833e5d1cb37c5a84, State: Initialized, Role: FOLLOWER
I20260619 04:39:52.289017 16280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } }
I20260619 04:39:52.289286 16280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:39:52.289446 16280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:39:52.289623 16280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:52.291913 16280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } }
I20260619 04:39:52.292466 16280 leader_election.cc:302] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1109aa8588fb4702833e5d1cb37c5a84; no voters:
I20260619 04:39:52.293109 16280 leader_election.cc:288] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:39:52.293264 16285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:52.294816 16285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 LEADER]: Becoming Leader. State: Replica: 1109aa8588fb4702833e5d1cb37c5a84, State: Running, Role: LEADER
I20260619 04:39:52.295439 16280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:52.295461 16285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } }
I20260619 04:39:52.298623 16287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1109aa8588fb4702833e5d1cb37c5a84. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } }
I20260619 04:39:52.298990 16287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:52.299475 16286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } }
I20260619 04:39:52.299813 16286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:52.299995 16293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:52.306202 16293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:52.315739 16293 catalog_manager.cc:1347] Generated new cluster ID: c479dcb4caa64cf6a596a960a39512c2
I20260619 04:39:52.315888 16293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:52.338421 16293 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:39:52.340512 16293 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:52.348510 16293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Generated new TSK 0
I20260619 04:39:52.349452 16293 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab.
Entry for principal oryx/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab.
I20260619 04:39:52.422331 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36341
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:52.776707 16306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:52.777089 16306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:52.777241 16306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:52.785193 16306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:52.785359 16306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:52.785560 16306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:52.796136 16306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:52.797655 16306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:52.799185 16306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:52.814172 16311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:52.814209 16314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:52.814283 16312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:52.815116 16306 server_base.cc:1034] running on GCE node
I20260619 04:39:52.815770 16306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:52.816843 16306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:52.818135 16306 hybrid_clock.cc:648] HybridClock initialized: now 1781843992818085 us; error 63 us; skew 500 ppm
I20260619 04:39:52.818543 16306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:52 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843992, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:52.822152 16306 init.cc:377] Logged in from keytab as oryx/127.9.224.65@KRBTEST.COM (short username oryx)
I20260619 04:39:52.823762 16306 webserver.cc:460] Webserver started at http://127.9.224.65:43653/ using document root <none> and password file <none>
I20260619 04:39:52.824507 16306 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:52.824625 16306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:52.824895 16306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:52.828045 16306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "76f39354b4bd4cc58e739ba871d6b62c"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "e2d42689498fbd7fa5f9833e95e02363"
server_key_iv: "c6bb1bf7e3dc21a25a0b2e48d4209318"
server_key_version: "encryptionkey@0"
I20260619 04:39:52.828822 16306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "76f39354b4bd4cc58e739ba871d6b62c"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "e2d42689498fbd7fa5f9833e95e02363"
server_key_iv: "c6bb1bf7e3dc21a25a0b2e48d4209318"
server_key_version: "encryptionkey@0"
I20260619 04:39:52.834686 16306 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 04:39:52.839347 16321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:52.840862 16306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260619 04:39:52.841068 16306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "76f39354b4bd4cc58e739ba871d6b62c"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "e2d42689498fbd7fa5f9833e95e02363"
server_key_iv: "c6bb1bf7e3dc21a25a0b2e48d4209318"
server_key_version: "encryptionkey@0"
I20260619 04:39:52.841297 16306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:52.884297 16306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:52.889019 16306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:52.889338 16306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:52.890455 16306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:52.891860 16306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:52.891933 16306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:52.892066 16306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:52.892130 16306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:52.926555 16306 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:38257
I20260619 04:39:52.926608 16433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:38257 every 8 connection(s)
I20260619 04:39:52.927927 16306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:52.928467 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16306
I20260619 04:39:52.928692 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:39:52.929548 10113 external_mini_cluster.cc:1428] Setting key c8fe0ca363a597558fd3a914bfca0949
Jun 19 04:39:52 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843992, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:52.953090 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:52.930764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:51783 (local address 127.9.224.126:36341)
0619 04:39:52.931225 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:52.931230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:52.932684 (+ 1454us) server_negotiation.cc:407] Connection header received
0619 04:39:52.934618 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:52.934626 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:52.934721 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:52.934837 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:52.936386 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:52.937556 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:52.940289 (+ 2733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:52.940692 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:52.940801 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:52.945342 (+ 4541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:52.945352 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:52.945360 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:52.945409 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:52.949347 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:52.950332 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:52.950338 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:52.950342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:52.950500 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:52.950986 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:52.950991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:52.950995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:52.951395 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:52.951575 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:52.952367 (+ 792us) server_negotiation.cc:299] Negotiation successful
0619 04:39:52.952672 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":262,"threads_started":1}
WARNING: no policy specified for oryx/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:39:52.954190 16437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:52.931609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:51783)
0619 04:39:52.932494 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:52.932557 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:52.934315 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:52.935047 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:52.935056 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:52.935609 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:52.936204 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:52.936222 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:52.937752 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:52.937761 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:52.940101 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:52.940127 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:52.940970 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:52.940979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:52.941322 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:52.942097 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:52.942132 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:52.945064 (+ 2932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:52.949564 (+ 4500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:52.949612 (+ 48us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:52.949627 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:52.950141 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:52.950647 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:52.950651 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:52.950653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:52.950849 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:52.951549 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:52.951556 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:52.951923 (+ 367us) client_negotiation.cc:769] Sending connection context
0619 04:39:52.952162 (+ 239us) client_negotiation.cc:240] Negotiation successful
0619 04:39:52.952814 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":379,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.66@KRBTEST.COM" created.
I20260619 04:39:52.956395 16434 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36341
I20260619 04:39:52.956790 16434 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:52.957783 16434 heartbeater.cc:511] Master 127.9.224.126:36341 requested a full tablet report, sending...
I20260619 04:39:52.960315 16245 ts_manager.cc:194] Registered new tserver with Master: 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257)
I20260619 04:39:52.961799 16245 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:51783
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab.
Entry for principal oryx/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab.
I20260619 04:39:52.982714 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36341
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:53.323876 16440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:53.324180 16440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:53.324278 16440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:53.331673 16440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:53.331805 16440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:53.331921 16440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:53.342312 16440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:53.343703 16440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:53.345095 16440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:53.359170 16445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:53.359083 16448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:53.359128 16446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:53.359970 16440 server_base.cc:1034] running on GCE node
I20260619 04:39:53.360618 16440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:53.361645 16440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:53.362900 16440 hybrid_clock.cc:648] HybridClock initialized: now 1781843993362834 us; error 56 us; skew 500 ppm
I20260619 04:39:53.363294 16440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:53 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843993, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:53.366737 16440 init.cc:377] Logged in from keytab as oryx/127.9.224.66@KRBTEST.COM (short username oryx)
I20260619 04:39:53.368468 16440 webserver.cc:460] Webserver started at http://127.9.224.66:45183/ using document root <none> and password file <none>
I20260619 04:39:53.369195 16440 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:53.369300 16440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:53.369575 16440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:53.372704 16440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "307fcf7f5fad46ba80a2999aef1b9393"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "9d51102f436e0d1865fe261ba0839204"
server_key_iv: "56a1f0ca7b5d2b36527cd607e47ba4a4"
server_key_version: "encryptionkey@0"
I20260619 04:39:53.373620 16440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "307fcf7f5fad46ba80a2999aef1b9393"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "9d51102f436e0d1865fe261ba0839204"
server_key_iv: "56a1f0ca7b5d2b36527cd607e47ba4a4"
server_key_version: "encryptionkey@0"
I20260619 04:39:53.379611 16440 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260619 04:39:53.383672 16455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:53.385331 16440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:39:53.385499 16440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "307fcf7f5fad46ba80a2999aef1b9393"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "9d51102f436e0d1865fe261ba0839204"
server_key_iv: "56a1f0ca7b5d2b36527cd607e47ba4a4"
server_key_version: "encryptionkey@0"
I20260619 04:39:53.385691 16440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:53.401983 16440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:53.406484 16440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:53.406735 16440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:53.407720 16440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:53.409343 16440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:53.409430 16440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:53.409523 16440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:53.409571 16440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:53.443974 16440 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:40411
I20260619 04:39:53.444064 16567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:40411 every 8 connection(s)
I20260619 04:39:53.445657 16440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:53.455371 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16440
I20260619 04:39:53.455585 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:39:53.456032 10113 external_mini_cluster.cc:1428] Setting key b77b3a05694427324fd40c318aa9b82e
Jun 19 04:39:53 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843993, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:53.468046 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:53.448481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:51361 (local address 127.9.224.126:36341)
0619 04:39:53.448663 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:53.448668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:53.449958 (+ 1290us) server_negotiation.cc:407] Connection header received
0619 04:39:53.451848 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:53.451853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:53.451929 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:53.452021 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:53.453568 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.454357 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.456133 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.456668 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.456819 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:53.461092 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:53.461102 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:53.461111 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:53.461159 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:53.464852 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:53.465665 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:53.465675 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:53.465677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:53.465807 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:53.466278 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:53.466284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:53.466289 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:53.466570 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:53.466731 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:53.467616 (+ 885us) server_negotiation.cc:299] Negotiation successful
0619 04:39:53.467795 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:39:53.469719 16570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:53.449057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:51361)
0619 04:39:53.449789 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:53.449828 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:53.451560 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:53.452260 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:53.452269 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:53.452784 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:53.453380 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:53.453398 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.454533 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.454537 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:53.455948 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:53.455961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.457021 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.457030 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:53.457317 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:53.458120 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:53.458151 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:53.460822 (+ 2671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:53.465017 (+ 4195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:53.465025 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:53.465041 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:53.465515 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:53.465926 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:53.465931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:53.465937 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:53.466134 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:53.466704 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:53.466714 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:53.467207 (+ 493us) client_negotiation.cc:769] Sending connection context
0619 04:39:53.467534 (+ 327us) client_negotiation.cc:240] Negotiation successful
0619 04:39:53.468157 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":292,"threads_started":1}
I20260619 04:39:53.471357 16568 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36341
I20260619 04:39:53.471698 16568 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:53.472605 16568 heartbeater.cc:511] Master 127.9.224.126:36341 requested a full tablet report, sending...
I20260619 04:39:53.474254 16245 ts_manager.cc:194] Registered new tserver with Master: 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:53.475562 16245 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:51361
WARNING: no policy specified for oryx/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab.
Entry for principal oryx/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab.
I20260619 04:39:53.510568 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36341
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:53.853240 16573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:53.853533 16573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:53.853628 16573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:53.861076 16573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:53.861187 16573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:53.861303 16573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:53.871491 16573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:53.872793 16573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:53.874097 16573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:53.887904 16581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:53.887974 16579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:53.888002 16578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:53.889497 16573 server_base.cc:1034] running on GCE node
I20260619 04:39:53.890338 16573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:53.891463 16573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:53.892800 16573 hybrid_clock.cc:648] HybridClock initialized: now 1781843993892718 us; error 66 us; skew 500 ppm
I20260619 04:39:53.893198 16573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:53 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843993, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:53.902158 16573 init.cc:377] Logged in from keytab as oryx/127.9.224.67@KRBTEST.COM (short username oryx)
I20260619 04:39:53.904134 16573 webserver.cc:460] Webserver started at http://127.9.224.67:41963/ using document root <none> and password file <none>
I20260619 04:39:53.904884 16573 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:53.904999 16573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:53.905258 16573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:53.908401 16573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "fa16815172824caaa0c6dbb8ce9b7c4f"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "849c632cbd415ef5d93a318a3f450197"
server_key_iv: "dbeea4350a1ae605561240ba51f1790b"
server_key_version: "encryptionkey@0"
I20260619 04:39:53.909183 16573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "fa16815172824caaa0c6dbb8ce9b7c4f"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "849c632cbd415ef5d93a318a3f450197"
server_key_iv: "dbeea4350a1ae605561240ba51f1790b"
server_key_version: "encryptionkey@0"
I20260619 04:39:53.914628 16573 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:39:53.918179 16588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:53.919713 16573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:53.919909 16573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "fa16815172824caaa0c6dbb8ce9b7c4f"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "849c632cbd415ef5d93a318a3f450197"
server_key_iv: "dbeea4350a1ae605561240ba51f1790b"
server_key_version: "encryptionkey@0"
I20260619 04:39:53.920151 16573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:53.938868 16573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:53.943503 16573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:53.943822 16573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:53.945101 16573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:53.946650 16573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:53.946754 16573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:53.946902 16573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:53.946970 16573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:53.965129 16434 heartbeater.cc:503] Master 127.9.224.126:36341 was elected leader, sending a full tablet report...
I20260619 04:39:53.982467 16573 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:34829
I20260619 04:39:53.982559 16700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:34829 every 8 connection(s)
I20260619 04:39:53.983824 16573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:53.993139 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16573
I20260619 04:39:53.993324 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:39:53.993769 10113 external_mini_cluster.cc:1428] Setting key aeb64906976b74dff3101ba0156f2bbd
Jun 19 04:39:53 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843993, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:54.005481 16703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:53.986665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:51255 (local address 127.9.224.126:36341)
0619 04:39:53.987219 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:53.987223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:53.988074 (+ 851us) server_negotiation.cc:407] Connection header received
0619 04:39:53.989972 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:53.989978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:53.990071 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:53.990194 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:53.991756 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.992520 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.994289 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.994815 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.994945 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:53.999252 (+ 4307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:53.999260 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:53.999265 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:53.999300 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.002521 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.003293 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.003297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.003300 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.003435 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.003846 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.003850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.003852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.004153 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.004302 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.005039 (+ 737us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.005210 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":354,"threads_started":1}
I20260619 04:39:54.006560 16704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:53.987176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:51255)
0619 04:39:53.987921 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:53.987959 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:53.989659 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:53.990469 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:53.990479 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:53.991011 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:53.991584 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:53.991602 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.992681 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.992685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:53.994111 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:53.994124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:53.995084 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:53.995091 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:53.995434 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:53.996228 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:53.996273 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:53.999026 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.002684 (+ 3658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.002693 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.002707 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.003161 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.003543 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.003546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.003548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.003738 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.004297 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.004304 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.004679 (+ 375us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.004930 (+ 251us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.005348 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":280,"threads_started":1}
I20260619 04:39:54.008001 16701 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36341
I20260619 04:39:54.008396 16701 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:54.009449 16701 heartbeater.cc:511] Master 127.9.224.126:36341 requested a full tablet report, sending...
I20260619 04:39:54.011072 16245 ts_manager.cc:194] Registered new tserver with Master: fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67:34829)
I20260619 04:39:54.011880 16245 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:51255
I20260619 04:39:54.022768 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.224.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.125.keytab.
Entry for principal oryx/127.9.224.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.125.keytab.
I20260619 04:39:54.070855 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:44335
--webserver_interface=127.9.224.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.125.keytab
--principal=oryx/127.9.224.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36341,127.9.224.125:44335
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:39:54.407697 16707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:54.408087 16707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:54.408249 16707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:54.415756 16707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:54.415926 16707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:54.416039 16707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:54.416138 16707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:54.416215 16707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:54.426888 16707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36341,127.9.224.125:44335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.125.keytab
--principal=oryx/127.9.224.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:44335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.224.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
W20260619 04:39:54.427281 16707 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.9.224.126:36341,127.9.224.125:44335'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260619 04:39:54.428318 16707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:54.429628 16707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:54.441498 16713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:54.441573 16715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:54.442152 16712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:54.442272 16707 server_base.cc:1034] running on GCE node
I20260619 04:39:54.443203 16707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:54.445333 16707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:54.446614 16707 hybrid_clock.cc:648] HybridClock initialized: now 1781843994446528 us; error 61 us; skew 500 ppm
I20260619 04:39:54.447059 16707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:54 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843994, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:54.451196 16707 init.cc:377] Logged in from keytab as oryx/127.9.224.125@KRBTEST.COM (short username oryx)
I20260619 04:39:54.452806 16707 webserver.cc:460] Webserver started at http://127.9.224.125:45839/ using document root <none> and password file <none>
I20260619 04:39:54.453598 16707 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:54.453737 16707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:54.454061 16707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:54.457281 16707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/instance:
uuid: "922e5dad8ed14b91af83f22b748816f2"
format_stamp: "Formatted at 2026-06-19 04:39:54 on dist-test-slave-9dgf"
server_key: "f0a9d69c21bd9f8966cd6fc52aa6baae"
server_key_iv: "bcc9617dd2ec5f100034ccaa91b5d5c4"
server_key_version: "encryptionkey@0"
I20260619 04:39:54.458105 16707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal/instance:
uuid: "922e5dad8ed14b91af83f22b748816f2"
format_stamp: "Formatted at 2026-06-19 04:39:54 on dist-test-slave-9dgf"
server_key: "f0a9d69c21bd9f8966cd6fc52aa6baae"
server_key_iv: "bcc9617dd2ec5f100034ccaa91b5d5c4"
server_key_version: "encryptionkey@0"
I20260619 04:39:54.463462 16707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:39:54.467044 16722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:54.468514 16707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:54.468727 16707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
uuid: "922e5dad8ed14b91af83f22b748816f2"
format_stamp: "Formatted at 2026-06-19 04:39:54 on dist-test-slave-9dgf"
server_key: "f0a9d69c21bd9f8966cd6fc52aa6baae"
server_key_iv: "bcc9617dd2ec5f100034ccaa91b5d5c4"
server_key_version: "encryptionkey@0"
I20260619 04:39:54.468962 16707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:54.479188 16568 heartbeater.cc:503] Master 127.9.224.126:36341 was elected leader, sending a full tablet report...
I20260619 04:39:54.505534 16707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:54.510299 16707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:54.510538 16707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:54.530467 16707 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.125:44335
I20260619 04:39:54.530443 16773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.125:44335 every 8 connection(s)
I20260619 04:39:54.531884 16707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
I20260619 04:39:54.533319 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16707
I20260619 04:39:54.536831 16774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:54.543705 16774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:39:54 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
Jun 19 04:39:54 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843994, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.125@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:54.556978 16777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.535758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37660 (local address 127.9.224.125:44335)
0619 04:39:54.536554 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.536567 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.536609 (+ 42us) server_negotiation.cc:407] Connection header received
0619 04:39:54.538380 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.538403 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.538800 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.539212 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.540713 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.542061 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.543381 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.544132 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.544370 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.549199 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.549206 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.549216 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.549260 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.552429 (+ 3169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.553149 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.553162 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.553169 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.553326 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.553734 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.553740 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.553743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.554334 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.554689 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.555111 (+ 422us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.555598 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":333,"threads_started":1}
I20260619 04:39:54.562163 16779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.546669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.9.224.126:36341)
0619 04:39:54.548007 (+ 1338us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.548013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.548033 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:39:54.548112 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.548117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.548203 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.548325 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.549543 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.550586 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.552168 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.552572 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.552713 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.556030 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.556037 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.556042 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.556087 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.559103 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.559988 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.559994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.559998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.560195 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.560612 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.560617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.560621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.560949 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.561121 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.561563 (+ 442us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.561788 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1213,"thread_start_us":1110,"threads_started":1}
I20260619 04:39:54.562206 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.546571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:60894)
0619 04:39:54.547338 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:54.547390 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:54.547559 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:54.548401 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:54.548407 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:54.549069 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:54.549375 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.549384 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.550721 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.550729 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.552004 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.552017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.552755 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.552762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.552934 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.553537 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:54.553554 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:54.555826 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.559243 (+ 3417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.559259 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.559265 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.559856 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.560347 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.560352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.560356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.560495 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.561075 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.561083 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.561261 (+ 178us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.561465 (+ 204us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.561792 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":310,"threads_started":1}
I20260619 04:39:54.563913 16774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:39:54 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843994, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.125@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
I20260619 04:39:54.576681 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.564745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37676)
0619 04:39:54.564945 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:54.564962 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:54.565052 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:54.565379 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:54.565382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:54.565685 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:54.565806 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.565812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.566881 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.566884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.567779 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.567790 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.568443 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.568447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.568569 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.569196 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:54.569214 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:54.571230 (+ 2016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.574363 (+ 3133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.574367 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.574370 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.574746 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.575231 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.575235 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.575237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.575382 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.575958 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.575961 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.576092 (+ 131us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.576204 (+ 112us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.576437 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260619 04:39:54.576999 16777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.564614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37676 (local address 127.9.224.125:44335)
0619 04:39:54.564851 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.564856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.565035 (+ 179us) server_negotiation.cc:407] Connection header received
0619 04:39:54.565194 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.565198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.565255 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.565338 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.565979 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.566745 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.567904 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.568310 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.568402 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.571407 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.571412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.571416 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.571446 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.574161 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.574910 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.574914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.574916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.575087 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.575512 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.575516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.575518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.575847 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.575965 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.576293 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.576599 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":58}
I20260619 04:39:54.584417 16774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Bootstrap starting.
I20260619 04:39:54.588150 16774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:54.589205 16774 log.cc:824] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:54.592160 16774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: No bootstrap required, opened a new log
I20260619 04:39:54.600628 16774 raft_consensus.cc:348] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } }
I20260619 04:39:54.601007 16774 raft_consensus.cc:374] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:54.601090 16774 raft_consensus.cc:729] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922e5dad8ed14b91af83f22b748816f2, State: Initialized, Role: FOLLOWER
I20260619 04:39:54.601815 16774 consensus_queue.cc:260] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } }
I20260619 04:39:54.602773 16781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } } }
I20260619 04:39:54.603137 16781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:39:54.603842 16774 sys_catalog.cc:564] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 04:39:54.612473 16792 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 04:39:54.612615 16792 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 04:39:54.616066 16707 master_runner.cc:428] Detected that this master 922e5dad8ed14b91af83f22b748816f2 is joining an existing cluster
I20260619 04:39:54.616184 16707 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.224.125:44335
WARNING: no policy specified for oryx/127.9.224.124@KRBTEST.COM; defaulting to no policy
I20260619 04:39:54.640216 16777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.620248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37686 (local address 127.9.224.125:44335)
0619 04:39:54.620463 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.620469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.621120 (+ 651us) server_negotiation.cc:407] Connection header received
0619 04:39:54.621405 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.621415 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.621495 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.621578 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.624876 (+ 3298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.626363 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.628564 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.629251 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.629383 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.631941 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.631949 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.631954 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.631987 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.636312 (+ 4325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.637228 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.637233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.637236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.637429 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.637846 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.637849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.637853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.638565 (+ 712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.638715 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.639564 (+ 849us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.639816 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.124@KRBTEST.COM" created.
I20260619 04:39:54.641266 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.620349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37686)
0619 04:39:54.621015 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:54.621036 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:54.621247 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:54.621827 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:54.621833 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:54.624014 (+ 2181us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:54.624594 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.624612 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.626608 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.626616 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.628430 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.628442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.629709 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.629715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.629896 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.630678 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:54.630700 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:54.631742 (+ 1042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.636456 (+ 4714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.636461 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.636466 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.637107 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.637572 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.637577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.637580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.637735 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.638799 (+ 1064us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.638804 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.638954 (+ 150us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.640498 (+ 1544us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.640819 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":380,"threads_started":1}
I20260619 04:39:54.644348 16779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.620178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60898 (local address 127.9.224.126:36341)
0619 04:39:54.620393 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.620401 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.628167 (+ 7766us) server_negotiation.cc:407] Connection header received
0619 04:39:54.628606 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.628614 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.628708 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.628777 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.630372 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.631510 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.633644 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.634427 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.634548 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.637315 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.637323 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.637327 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.637371 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.641160 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.642081 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.642087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.642090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.642276 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.642754 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.642760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.642762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.643118 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.643238 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.643765 (+ 527us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.643986 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:39:54.644496 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.621335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:60898)
0619 04:39:54.628054 (+ 6719us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:54.628075 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:54.628455 (+ 380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:54.628991 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:54.628997 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:54.629811 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:54.630159 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.630174 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.631729 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.631734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.633462 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.633481 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.634916 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.634923 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.635128 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.635718 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:54.635741 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:54.637112 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.641324 (+ 4212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.641329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.641332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.641942 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.642437 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.642441 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.642444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.642622 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.643310 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.643313 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.643466 (+ 153us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.643668 (+ 202us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.643980 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6573,"thread_start_us":6851,"threads_started":1}
Jun 19 04:39:54 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843992, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.126@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
I20260619 04:39:54.665612 16777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.651100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37700 (local address 127.9.224.125:44335)
0619 04:39:54.651256 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.651261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.651497 (+ 236us) server_negotiation.cc:407] Connection header received
0619 04:39:54.651848 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.651853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.651986 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.652047 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.653314 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.654068 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.655491 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.655948 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.656100 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.659542 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.659550 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.659554 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.659585 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.662715 (+ 3130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.663450 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.663456 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.663459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.663598 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.664027 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.664032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.664037 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.664299 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.664481 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.664979 (+ 498us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.665212 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:39:54.665663 16802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.650739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37700)
0619 04:39:54.651371 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:54.651421 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:54.651632 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:54.652247 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:54.652252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:54.652887 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:54.653154 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.653164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.654197 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.654203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.655316 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.655336 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.656114 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.656120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.656334 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.657022 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:54.657040 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:54.659339 (+ 2299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.662867 (+ 3528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.662882 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.662891 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.663326 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.663752 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.663757 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.663761 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.663922 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.664470 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.664480 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.664663 (+ 183us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.664869 (+ 206us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.665223 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":534,"threads_started":1}
I20260619 04:39:54.668257 16245 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.224.125:44335: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "922e5dad8ed14b91af83f22b748816f2"
member_type: NON_VOTER
last_known_addr {
host: "127.9.224.125"
port: 44335
}
attrs {
promote: true
}
}
dest_uuid: "1109aa8588fb4702833e5d1cb37c5a84"
cas_config_opid_index: -1
I20260619 04:39:54.669545 16245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.124.keytab.
Entry for principal oryx/127.9.224.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.124.keytab.
I20260619 04:39:54.674468 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:33397
--webserver_interface=127.9.224.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.124.keytab
--principal=oryx/127.9.224.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:39:54.674703 16749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:54.679876 16749 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Refusing update from remote peer 1109aa8588fb4702833e5d1cb37c5a84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260619 04:39:54.682303 16805 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 922e5dad8ed14b91af83f22b748816f2 (127.9.224.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } }
I20260619 04:39:54.686628 16804 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:54.687036 16805 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.224.125:44335
I20260619 04:39:54.687806 16707 master.cc:537] Master@127.9.224.125:44335 shutting down...
I20260619 04:39:54.691274 16806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } }
I20260619 04:39:54.691630 16806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
W20260619 04:39:54.694475 16230 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260619 04:39:54.697098 16230 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 -> Peer 922e5dad8ed14b91af83f22b748816f2 (127.9.224.125:44335): Couldn't send request to peer 922e5dad8ed14b91af83f22b748816f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260619 04:39:54.703825 16707 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:54.704350 16707 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:54.704581 16707 tablet_replica.cc:330] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: stopping tablet replica
I20260619 04:39:54.711090 16707 master.cc:552] Master@127.9.224.125:44335 shutdown complete.
I20260619 04:39:54.711194 16707 master_runner.cc:305] Clearing existing system tablet
I20260619 04:39:54.711585 16707 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:54.711689 16707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:54.713964 16707 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260619 04:39:54.715551 16812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:54.715895 16707 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:54.716210 16707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260619 04:39:54.716308 16707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
uuid: "922e5dad8ed14b91af83f22b748816f2"
format_stamp: "Formatted at 2026-06-19 04:39:54 on dist-test-slave-9dgf"
server_key: "f0a9d69c21bd9f8966cd6fc52aa6baae"
server_key_iv: "bcc9617dd2ec5f100034ccaa91b5d5c4"
server_key_version: "encryptionkey@0"
I20260619 04:39:54.720330 16707 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:54.725502 16707 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260619 04:39:54.725697 16707 log.cc:1196] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260619 04:39:54.726138 16707 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Deleting consensus metadata
I20260619 04:39:54.726469 16707 master_runner.cc:315] Copying system tablet from 127.9.224.126:36341
I20260619 04:39:54.728950 16707 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: tablet copy: Beginning tablet copy session from remote peer at address 127.9.224.126:36341
I20260619 04:39:54.744940 16779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.729738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60910 (local address 127.9.224.126:36341)
0619 04:39:54.729969 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:54.729979 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:54.730516 (+ 537us) server_negotiation.cc:407] Connection header received
0619 04:39:54.730808 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:54.730814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:54.730900 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:54.731025 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:54.731873 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.732603 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.733896 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.734503 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.734584 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.737132 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:54.737141 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:54.737149 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:54.737199 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:54.741440 (+ 4241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.742347 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.742355 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.742358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.742516 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:54.743010 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:54.743015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:54.743018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:54.743413 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:54.743543 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:54.744172 (+ 629us) server_negotiation.cc:299] Negotiation successful
0619 04:39:54.744450 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 04:39:54.746162 16818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:54.729682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:60910)
0619 04:39:54.730388 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:54.730411 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:54.730585 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:54.731056 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:54.731061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:54.731486 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:54.731701 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.731725 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.732752 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.732757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.733700 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:54.733720 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:54.734829 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:54.734834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:54.734956 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:54.735639 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:54.735657 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:54.736838 (+ 1181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:54.741629 (+ 4791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.741635 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.741639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.742157 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.742691 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:54.742697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:54.742703 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:54.742876 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:54.743652 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:54.743657 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:54.743873 (+ 216us) client_negotiation.cc:769] Sending connection context
0619 04:39:54.745213 (+ 1340us) client_negotiation.cc:240] Negotiation successful
0619 04:39:54.745619 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":443,"threads_started":1}
I20260619 04:39:54.748564 16265 tablet_copy_service.cc:140] P 1109aa8588fb4702833e5d1cb37c5a84: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 922e5dad8ed14b91af83f22b748816f2 ({username='oryx', principal='oryx/127.9.224.125@KRBTEST.COM'} at 127.0.0.1:60910)
I20260619 04:39:54.748867 16265 tablet_copy_service.cc:161] P 1109aa8588fb4702833e5d1cb37c5a84: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 922e5dad8ed14b91af83f22b748816f2 at {username='oryx', principal='oryx/127.9.224.125@KRBTEST.COM'} at 127.0.0.1:60910: session id = 922e5dad8ed14b91af83f22b748816f2-00000000000000000000000000000000
I20260619 04:39:54.752140 16265 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 04:39:54.754312 16707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260619 04:39:54.759331 16707 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: tablet copy: Starting download of 0 data blocks...
I20260619 04:39:54.759665 16707 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: tablet copy: Starting download of 1 WAL segments...
I20260619 04:39:54.762214 16707 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 04:39:54.765679 16265 tablet_copy_service.cc:342] P 1109aa8588fb4702833e5d1cb37c5a84: Request end of tablet copy session 922e5dad8ed14b91af83f22b748816f2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.224.125@KRBTEST.COM'} at 127.0.0.1:60910
I20260619 04:39:54.765892 16265 tablet_copy_service.cc:433] P 1109aa8588fb4702833e5d1cb37c5a84: ending tablet copy session 922e5dad8ed14b91af83f22b748816f2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 922e5dad8ed14b91af83f22b748816f2
I20260619 04:39:54.776445 16707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:54.779218 16819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:54.790596 16820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:54.792879 16822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:54.793100 16707 server_base.cc:1034] running on GCE node
I20260619 04:39:54.793607 16707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:54.794389 16707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:54.795600 16707 hybrid_clock.cc:648] HybridClock initialized: now 1781843994795537 us; error 34 us; skew 500 ppm
I20260619 04:39:54.795898 16707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:54 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843994, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:54.797995 16707 init.cc:377] Logged in from keytab as oryx/127.9.224.125@KRBTEST.COM (short username oryx)
I20260619 04:39:54.803211 16707 webserver.cc:460] Webserver started at http://127.9.224.125:37159/ using document root <none> and password file <none>
I20260619 04:39:54.803584 16707 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:54.803681 16707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:54.806154 16707 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260619 04:39:54.807982 16829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:54.808416 16707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260619 04:39:54.808573 16707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
uuid: "922e5dad8ed14b91af83f22b748816f2"
format_stamp: "Formatted at 2026-06-19 04:39:54 on dist-test-slave-9dgf"
server_key: "f0a9d69c21bd9f8966cd6fc52aa6baae"
server_key_iv: "bcc9617dd2ec5f100034ccaa91b5d5c4"
server_key_version: "encryptionkey@0"
I20260619 04:39:54.808736 16707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:54.834426 16707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:54.838215 16707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:54.867302 16707 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.125:44335
I20260619 04:39:54.867326 16880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.125:44335 every 8 connection(s)
I20260619 04:39:54.868266 16707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
I20260619 04:39:54.875623 16881 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:39:54.881170 16881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Bootstrap starting.
I20260619 04:39:54.897135 16881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:39:54.897620 16881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Bootstrap complete.
I20260619 04:39:54.898545 16881 raft_consensus.cc:348] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } }
I20260619 04:39:54.898784 16881 raft_consensus.cc:729] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 922e5dad8ed14b91af83f22b748816f2, State: Initialized, Role: LEARNER
I20260619 04:39:54.899065 16881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } }
I20260619 04:39:54.899871 16884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } }
I20260619 04:39:54.900202 16881 sys_catalog.cc:564] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:54.900238 16884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: LEARNER
I20260619 04:39:54.909162 16895 catalog_manager.cc:1259] Loaded cluster ID: c479dcb4caa64cf6a596a960a39512c2
I20260619 04:39:54.909286 16895 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: loading cluster ID for follower catalog manager: success
I20260619 04:39:54.911983 16895 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: acquiring CA information for follower catalog manager: success
I20260619 04:39:54.913985 16895 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 04:39:55.014556 16701 heartbeater.cc:503] Master 127.9.224.126:36341 was elected leader, sending a full tablet report...
W20260619 04:39:55.115078 16807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:55.115388 16807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:55.115530 16807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:55.123135 16807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:39:55.123253 16807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:55.123338 16807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:55.123435 16807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:39:55.123517 16807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:39:55.133919 16807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.124.keytab
--principal=oryx/127.9.224.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:33397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.224.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:55.135429 16807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:55.136824 16807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:55.149500 16903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:55.149448 16901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:55.149533 16900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:55.150444 16807 server_base.cc:1034] running on GCE node
I20260619 04:39:55.151332 16807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:55.152917 16807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:55.154140 16807 hybrid_clock.cc:648] HybridClock initialized: now 1781843995154089 us; error 40 us; skew 500 ppm
I20260619 04:39:55.154598 16807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843995, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:55.158586 16807 init.cc:377] Logged in from keytab as oryx/127.9.224.124@KRBTEST.COM (short username oryx)
I20260619 04:39:55.160516 16807 webserver.cc:460] Webserver started at http://127.9.224.124:36931/ using document root <none> and password file <none>
I20260619 04:39:55.161302 16807 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:55.161443 16807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:55.161742 16807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:39:55.165182 16807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/instance:
uuid: "0f56af58a57147c486ecf66d50bd287b"
format_stamp: "Formatted at 2026-06-19 04:39:55 on dist-test-slave-9dgf"
server_key: "d1d6caa270fc5cfc11604de5ceabdeb9"
server_key_iv: "8bc521bfd731fcf8bb48eb9758b14d4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:55.166007 16807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal/instance:
uuid: "0f56af58a57147c486ecf66d50bd287b"
format_stamp: "Formatted at 2026-06-19 04:39:55 on dist-test-slave-9dgf"
server_key: "d1d6caa270fc5cfc11604de5ceabdeb9"
server_key_iv: "8bc521bfd731fcf8bb48eb9758b14d4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:55.171918 16807 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260619 04:39:55.175976 16910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:55.177644 16807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:55.177856 16807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
uuid: "0f56af58a57147c486ecf66d50bd287b"
format_stamp: "Formatted at 2026-06-19 04:39:55 on dist-test-slave-9dgf"
server_key: "d1d6caa270fc5cfc11604de5ceabdeb9"
server_key_iv: "8bc521bfd731fcf8bb48eb9758b14d4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:55.178081 16807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:55.211869 16807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:55.216758 16807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:55.217070 16807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:55.236529 16807 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.124:33397
I20260619 04:39:55.236552 16961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.124:33397 every 8 connection(s)
I20260619 04:39:55.238158 16807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
I20260619 04:39:55.240685 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 16807
I20260619 04:39:55.242611 16962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:55.252528 16962 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.124@KRBTEST.COM
I20260619 04:39:55.273641 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.243163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57146 (local address 127.9.224.124:33397)
0619 04:39:55.244024 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.244037 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.244081 (+ 44us) server_negotiation.cc:407] Connection header received
0619 04:39:55.245792 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.245820 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.246415 (+ 595us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.246995 (+ 580us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.248570 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.249965 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.251357 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.252151 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.252369 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.259984 (+ 7615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.260001 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.260036 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.260125 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.265432 (+ 5307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.266802 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.266816 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.266829 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.267122 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.267782 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.267789 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.267795 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.268804 (+ 1009us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.270846 (+ 2042us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.271233 (+ 387us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.271878 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":400,"threads_started":1}
I20260619 04:39:55.284840 16970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.265208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37714 (local address 127.9.224.125:44335)
0619 04:39:55.276482 (+ 11274us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.276492 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.277243 (+ 751us) server_negotiation.cc:407] Connection header received
0619 04:39:55.277509 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.277515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.277622 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.277730 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:55.278619 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.280196 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.282611 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.283701 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.283862 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.284106 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.284357 (+ 251us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.284507 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11074,"thread_start_us":10934,"threads_started":1}
I20260619 04:39:55.284899 16969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.265002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37714)
0619 04:39:55.277119 (+ 12117us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.277138 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.277350 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.278033 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.278039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.278095 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:55.278448 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.278461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.280351 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.280359 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.282447 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.282464 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.283948 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.283954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.284139 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.284195 (+ 56us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.284303 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.284471 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12006,"mutex_wait_us":30,"spinlock_wait_cycles":14464,"thread_start_us":11922,"threads_started":1}
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843995, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.124@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:55.286157 16856 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260619 04:39:55.286808 16884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1109aa8588fb4702833e5d1cb37c5a84. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } }
I20260619 04:39:55.287089 16884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: LEARNER
I20260619 04:39:55.292867 16968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.263746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60912 (local address 127.9.224.126:36341)
0619 04:39:55.276935 (+ 13189us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.276944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.276970 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:39:55.277044 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.277050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.277138 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.278042 (+ 904us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.278939 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.280055 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.282139 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.282746 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.282889 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.286771 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.286776 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.286779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.286816 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.289884 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.290771 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.290777 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.290780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.290911 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.291313 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.291317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.291319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.291580 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.291744 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.292199 (+ 455us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.292433 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":13028,"spinlock_wait_cycles":4864,"thread_start_us":12910,"threads_started":1}
I20260619 04:39:55.292881 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.255890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:60912)
0619 04:39:55.262949 (+ 7059us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.263000 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.263178 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.277394 (+ 14216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.277405 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.278507 (+ 1102us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.278773 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.278784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.280212 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.280215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.281982 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.281999 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.282984 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.282989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.283122 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.283883 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.283904 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.286561 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.290050 (+ 3489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.290065 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.290073 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.290616 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.291027 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.291032 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.291035 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.291179 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.291711 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.291720 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.291898 (+ 178us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.292096 (+ 198us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.292444 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6757,"thread_start_us":6567,"threads_started":1}
I20260619 04:39:55.295492 16962 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843995, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.124@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
I20260619 04:39:55.311509 16970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.296831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37718 (local address 127.9.224.125:44335)
0619 04:39:55.297039 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.297044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.297144 (+ 100us) server_negotiation.cc:407] Connection header received
0619 04:39:55.297337 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.297342 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.297423 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.297525 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.298308 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.299086 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.300601 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.301237 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.301347 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.305567 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.305572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.305576 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.305615 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.308559 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.309462 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.309467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.309469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.309602 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.309995 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.310000 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.310003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.310402 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.310560 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.310922 (+ 362us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.311151 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 04:39:55.311504 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.296786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37718)
0619 04:39:55.297055 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.297073 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.297183 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.297556 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.297560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.297930 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.298076 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.298083 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.299277 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.299281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.300436 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.300451 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.301449 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.301455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.301597 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.302422 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.302441 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.305313 (+ 2872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.308740 (+ 3427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.308747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.308753 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.309317 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.309723 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.309728 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.309732 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.309880 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.310517 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.310522 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.310681 (+ 159us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.310826 (+ 145us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.311150 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260619 04:39:55.312738 16962 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843995, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.124@KRBTEST.COM for oryx/127.9.224.124@KRBTEST.COM
I20260619 04:39:55.326766 16967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.313607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57148)
0619 04:39:55.313861 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.313886 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.314021 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.314348 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.314352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.314766 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.314912 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.314920 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.315925 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.315933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.316780 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.316791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.317470 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.317475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.317668 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.318401 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.318419 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.320665 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.324143 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.324148 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.324151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.324743 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.325148 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.325152 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.325156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.325318 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.325852 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.325856 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.326031 (+ 175us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.326155 (+ 124us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.326439 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260619 04:39:55.326849 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.313607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57148 (local address 127.9.224.124:33397)
0619 04:39:55.313837 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.313843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.313951 (+ 108us) server_negotiation.cc:407] Connection header received
0619 04:39:55.314140 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.314143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.314199 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.314322 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.315050 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.315798 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.316915 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.317306 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.317443 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.320882 (+ 3439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.320887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.320891 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.320922 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.323954 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.324901 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.324905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.324907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.325034 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.325442 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.325446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.325448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.325733 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.325855 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.326369 (+ 514us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.326562 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:39:55.332041 16962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Bootstrap starting.
I20260619 04:39:55.335438 16962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:55.336575 16962 log.cc:824] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:55.339779 16962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: No bootstrap required, opened a new log
I20260619 04:39:55.347312 16962 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } }
I20260619 04:39:55.347627 16962 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:55.347751 16962 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f56af58a57147c486ecf66d50bd287b, State: Initialized, Role: FOLLOWER
I20260619 04:39:55.348423 16962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } }
I20260619 04:39:55.349372 16972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } } }
I20260619 04:39:55.349773 16972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:39:55.350453 16962 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: configured and running, proceeding with master startup.
W20260619 04:39:55.360065 16983 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 04:39:55.360224 16983 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 04:39:55.364696 16807 master_runner.cc:428] Detected that this master 0f56af58a57147c486ecf66d50bd287b is joining an existing cluster
I20260619 04:39:55.364828 16807 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.224.124:33397
I20260619 04:39:55.381789 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16306
I20260619 04:39:55.391245 16970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.369413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37724 (local address 127.9.224.125:44335)
0619 04:39:55.369604 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.369610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.370901 (+ 1291us) server_negotiation.cc:407] Connection header received
0619 04:39:55.371160 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.371166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.371245 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.371361 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.372532 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.373343 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.375885 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.376614 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.376777 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.379810 (+ 3033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.379818 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.379823 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.379873 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.383986 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.388089 (+ 4103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.388096 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.388100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.388289 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.388837 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.388843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.388847 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.389277 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.389431 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.390496 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.390778 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 04:39:55.391641 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.369878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57160)
0619 04:39:55.374287 (+ 4409us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.374319 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.375251 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.375685 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.375689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.377577 (+ 1888us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.377915 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.377929 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.379526 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.379531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.381040 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.381054 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.382305 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.382314 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.382522 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.383119 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.383160 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.384157 (+ 997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.388562 (+ 4405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.388570 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.388574 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.389121 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.389569 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.389573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.389579 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.389711 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.390420 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.390425 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.390564 (+ 139us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.390817 (+ 253us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.391121 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4206,"spinlock_wait_cycles":29056,"thread_start_us":4737,"threads_started":1}
I20260619 04:39:55.392746 16989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.369714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37724)
0619 04:39:55.370763 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.370792 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.371015 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.371386 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.371391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.372040 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.372356 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.372367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.373526 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.373532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.375704 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.375723 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.376870 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.376880 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.377122 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.377992 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.378018 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.379515 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.384177 (+ 4662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.384185 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.384192 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.384887 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.388473 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.388478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.388482 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.388692 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.389754 (+ 1062us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.389759 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.390116 (+ 357us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.391838 (+ 1722us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.392221 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"thread_start_us":664,"threads_started":1}
I20260619 04:39:55.393648 16968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.369296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60920 (local address 127.9.224.126:36341)
0619 04:39:55.369485 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.369492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.375025 (+ 5533us) server_negotiation.cc:407] Connection header received
0619 04:39:55.375209 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.375215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.375307 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.375402 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.377005 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.378193 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.380334 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.381048 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.381162 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.384071 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.384081 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.384087 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.384130 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.389175 (+ 5045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.390044 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.390052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.390056 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.390214 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.391022 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.391027 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.391031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.391407 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.392917 (+ 1510us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.393073 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.393338 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:39:55.392846 16991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.369914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:60920)
0619 04:39:55.374909 (+ 4995us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.374923 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.375075 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.375601 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.375608 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.376423 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.376802 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.376815 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.378412 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.378417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.380159 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.380175 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.381451 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.381458 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.381710 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.382584 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.382613 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.383837 (+ 1224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.389308 (+ 5471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.389312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.389315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.389824 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.390572 (+ 748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.390577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.390580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.390763 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.391557 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.391562 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.391816 (+ 254us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.391970 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.392389 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4858,"mutex_wait_us":141,"thread_start_us":3967,"threads_started":1}
I20260619 04:39:55.394518 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.369248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57160 (local address 127.9.224.124:33397)
0619 04:39:55.369463 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.369469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.374430 (+ 4961us) server_negotiation.cc:407] Connection header received
0619 04:39:55.375367 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.375374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.375436 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.375499 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.378072 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.379328 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.381176 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.381883 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.382000 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.384343 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.384349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.384353 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.384410 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.388407 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.389282 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.389290 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.389293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.389451 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.389824 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.389829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.389832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.390303 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.392355 (+ 2052us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.392489 (+ 134us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.392713 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":60}
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.65@KRBTEST.COM
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843992, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.126@KRBTEST.COM for oryx/127.9.224.124@KRBTEST.COM
I20260619 04:39:55.413483 16992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.383844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53126 (local address 127.9.224.65:38257)
0619 04:39:55.385655 (+ 1811us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.385667 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.385702 (+ 35us) server_negotiation.cc:407] Connection header received
0619 04:39:55.385776 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.385785 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.386114 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.386373 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.392912 (+ 6539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.395549 (+ 2637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.397601 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.398589 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.398728 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.405055 (+ 6327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.405078 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.405102 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.405160 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.409637 (+ 4477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.410692 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.410703 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.410707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.410915 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.411448 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.411456 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.411460 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.411954 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.412303 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.412703 (+ 400us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.413013 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1590,"thread_start_us":1426,"threads_started":1}
I20260619 04:39:55.415436 16429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:55.416113 16969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.400588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57168)
0619 04:39:55.400797 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.400817 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.400964 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.401452 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.401458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.402010 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.402210 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.402264 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.403713 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.403718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.404779 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.404792 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.405610 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.405617 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.405814 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.406430 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.406449 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.408664 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.412996 (+ 4332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.413002 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.413005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.413598 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.414127 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.414132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.414136 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.414342 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.415006 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.415012 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.415211 (+ 199us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.415367 (+ 156us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.415703 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260619 04:39:55.416358 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.400651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57168 (local address 127.9.224.124:33397)
0619 04:39:55.400806 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.400813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.400891 (+ 78us) server_negotiation.cc:407] Connection header received
0619 04:39:55.401206 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.401213 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.401310 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.401397 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.402458 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.403520 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.404945 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.405434 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.405576 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.408876 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.408883 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.408888 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.408930 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.412817 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.413811 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.413817 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.413821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.413979 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.414464 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.414468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.414471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.414860 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.415020 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.415534 (+ 514us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.415853 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 04:39:55.418572 16245 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.224.124:33397: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0f56af58a57147c486ecf66d50bd287b"
member_type: NON_VOTER
last_known_addr {
host: "127.9.224.124"
port: 33397
}
attrs {
promote: true
}
}
dest_uuid: "1109aa8588fb4702833e5d1cb37c5a84"
cas_config_opid_index: 5
I20260619 04:39:55.419704 16245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } }
I20260619 04:39:55.421666 16966 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0f56af58a57147c486ecf66d50bd287b (127.9.224.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.425930 16966 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.224.124:33397
I20260619 04:39:55.427246 16807 master.cc:537] Master@127.9.224.124:33397 shutting down...
I20260619 04:39:55.427320 16856 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 LEARNER]: Refusing update from remote peer 1109aa8588fb4702833e5d1cb37c5a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260619 04:39:55.451418 16994 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260619 04:39:55.452030 16229 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 -> Peer 0f56af58a57147c486ecf66d50bd287b (127.9.224.124:33397): Couldn't send request to peer 0f56af58a57147c486ecf66d50bd287b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260619 04:39:55.464147 16856 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0f56af58a57147c486ecf66d50bd287b (127.9.224.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.465139 16807 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:55.465652 16807 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:55.465893 16807 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: stopping tablet replica
I20260619 04:39:55.469811 16884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.470103 16884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: LEARNER
I20260619 04:39:55.472100 16994 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: attempting to promote NON_VOTER 922e5dad8ed14b91af83f22b748816f2 to VOTER
I20260619 04:39:55.472146 16995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.472560 16995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:55.473112 16994 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } }
I20260619 04:39:55.476468 16969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.475917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57178)
0619 04:39:55.476149 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.476281 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260619 04:39:55.476593 16856 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 LEARNER]: Refusing update from remote peer 1109aa8588fb4702833e5d1cb37c5a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260619 04:39:55.477317 16997 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260619 04:39:55.478206 16969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.477648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57182)
0619 04:39:55.477969 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.478057 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
W20260619 04:39:55.478511 16229 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 -> Peer 0f56af58a57147c486ecf66d50bd287b (127.9.224.124:33397): Couldn't send request to peer 0f56af58a57147c486ecf66d50bd287b. Status: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 04:39:55.480266 16807 master.cc:552] Master@127.9.224.124:33397 shutdown complete.
I20260619 04:39:55.481693 16807 master_runner.cc:305] Clearing existing system tablet
I20260619 04:39:55.481093 16856 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 922e5dad8ed14b91af83f22b748816f2 (127.9.224.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.482851 16807 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:55.483224 16807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:55.486413 16997 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 922e5dad8ed14b91af83f22b748816f2 (127.9.224.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.490525 16966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: NON_VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: true } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.491030 16966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:55.491739 16884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.492084 16884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:39:55.494422 16807 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.004s sys 0.001s
I20260619 04:39:55.497771 16995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.498027 16995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:55.498292 16994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.498698 16994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:55.501981 17002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:55.502514 16807 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:55.502796 16807 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.000s
I20260619 04:39:55.502898 16807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
uuid: "0f56af58a57147c486ecf66d50bd287b"
format_stamp: "Formatted at 2026-06-19 04:39:55 on dist-test-slave-9dgf"
server_key: "d1d6caa270fc5cfc11604de5ceabdeb9"
server_key_iv: "8bc521bfd731fcf8bb48eb9758b14d4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:55.506661 16807 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:55.511813 16807 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260619 04:39:55.512006 16807 log.cc:1196] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260619 04:39:55.512437 16807 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Deleting consensus metadata
I20260619 04:39:55.512681 16807 master_runner.cc:315] Copying system tablet from 127.9.224.126:36341
I20260619 04:39:55.515285 16807 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.224.126:36341
I20260619 04:39:55.530370 16968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.516097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.9.224.126:36341)
0619 04:39:55.516368 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:55.516378 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:55.518813 (+ 2435us) server_negotiation.cc:407] Connection header received
0619 04:39:55.519026 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:55.519032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:55.519109 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:55.519225 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:55.520056 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.520808 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.522060 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.522628 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.522769 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.524844 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:55.524849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:55.524852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:55.524885 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:55.527690 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.528349 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.528357 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.528360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.528493 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:55.528879 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:55.528885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:55.528888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:55.529173 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:55.529329 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:55.529731 (+ 402us) server_negotiation.cc:299] Negotiation successful
0619 04:39:55.529945 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260619 04:39:55.530718 17008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:55.516097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:60934)
0619 04:39:55.518677 (+ 2580us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:55.518699 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:55.518889 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:55.519256 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:55.519261 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:55.519705 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:55.519898 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.519907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.520964 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.520970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.521910 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:55.521922 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:55.522786 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:55.522792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:55.522977 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:55.523692 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:55.523716 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:55.524628 (+ 912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:55.527844 (+ 3216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.527849 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.527853 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.528224 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.528613 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:55.528618 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:55.528622 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:55.528774 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:55.529291 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:55.529296 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:55.529478 (+ 182us) client_negotiation.cc:769] Sending connection context
0619 04:39:55.529617 (+ 139us) client_negotiation.cc:240] Negotiation successful
0619 04:39:55.529945 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2447,"thread_start_us":2299,"threads_started":1}
I20260619 04:39:55.531347 16265 tablet_copy_service.cc:140] P 1109aa8588fb4702833e5d1cb37c5a84: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0f56af58a57147c486ecf66d50bd287b ({username='oryx', principal='oryx/127.9.224.124@KRBTEST.COM'} at 127.0.0.1:60934)
I20260619 04:39:55.531541 16265 tablet_copy_service.cc:161] P 1109aa8588fb4702833e5d1cb37c5a84: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0f56af58a57147c486ecf66d50bd287b at {username='oryx', principal='oryx/127.9.224.124@KRBTEST.COM'} at 127.0.0.1:60934: session id = 0f56af58a57147c486ecf66d50bd287b-00000000000000000000000000000000
I20260619 04:39:55.533844 16265 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 04:39:55.535588 16807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260619 04:39:55.540519 16807 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: tablet copy: Starting download of 0 data blocks...
I20260619 04:39:55.540846 16807 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: tablet copy: Starting download of 1 WAL segments...
I20260619 04:39:55.543248 16807 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 04:39:55.546792 16265 tablet_copy_service.cc:342] P 1109aa8588fb4702833e5d1cb37c5a84: Request end of tablet copy session 0f56af58a57147c486ecf66d50bd287b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.224.124@KRBTEST.COM'} at 127.0.0.1:60934
I20260619 04:39:55.546945 16265 tablet_copy_service.cc:433] P 1109aa8588fb4702833e5d1cb37c5a84: ending tablet copy session 0f56af58a57147c486ecf66d50bd287b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0f56af58a57147c486ecf66d50bd287b
I20260619 04:39:55.556957 16807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:55.559823 17009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:55.563894 17010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:55.576251 17012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:55.577126 16807 server_base.cc:1034] running on GCE node
I20260619 04:39:55.577162 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16306
I20260619 04:39:55.577481 16807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:55.578222 16807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:55.579463 16807 hybrid_clock.cc:648] HybridClock initialized: now 1781843995579423 us; error 30 us; skew 500 ppm
I20260619 04:39:55.579730 16807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:55 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843995, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:55.582067 16807 init.cc:377] Logged in from keytab as oryx/127.9.224.124@KRBTEST.COM (short username oryx)
I20260619 04:39:55.586302 16807 webserver.cc:460] Webserver started at http://127.9.224.124:39427/ using document root <none> and password file <none>
I20260619 04:39:55.586709 16807 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:55.586830 16807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:55.590688 16807 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:39:55.593111 17019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:55.593621 16807 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 04:39:55.593763 16807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
uuid: "0f56af58a57147c486ecf66d50bd287b"
format_stamp: "Formatted at 2026-06-19 04:39:55 on dist-test-slave-9dgf"
server_key: "d1d6caa270fc5cfc11604de5ceabdeb9"
server_key_iv: "8bc521bfd731fcf8bb48eb9758b14d4a"
server_key_version: "encryptionkey@0"
I20260619 04:39:55.593981 16807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:55.603328 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:38257
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:36341
--webserver_port=43653
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:39:55.619938 16807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:55.624794 16807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:55.650336 16807 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.124:33397
I20260619 04:39:55.650382 17071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.124:33397 every 8 connection(s)
I20260619 04:39:55.651407 16807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
I20260619 04:39:55.656975 17072 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:39:55.661221 17072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Bootstrap starting.
I20260619 04:39:55.680366 17072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:39:55.680934 17072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: Bootstrap complete.
I20260619 04:39:55.682034 17072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } }
I20260619 04:39:55.682387 17072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f56af58a57147c486ecf66d50bd287b, State: Initialized, Role: LEARNER
I20260619 04:39:55.682650 17072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } }
I20260619 04:39:55.683476 17075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:55.683779 17072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:39:55.683961 17075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: This master's current role is: LEARNER
I20260619 04:39:55.691772 17086 catalog_manager.cc:1259] Loaded cluster ID: c479dcb4caa64cf6a596a960a39512c2
I20260619 04:39:55.691883 17086 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: loading cluster ID for follower catalog manager: success
I20260619 04:39:55.695338 17086 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: acquiring CA information for follower catalog manager: success
I20260619 04:39:55.697770 17086 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 04:39:55.995426 17024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:55.995797 17024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:55.995955 17024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:56.004349 17024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:56.004485 17024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:56.004707 17024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:39:56.015368 17024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:38257
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=43653
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:56.016844 17024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:56.018607 17024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:56.032892 17094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:56.032946 17092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:56.032856 17091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:56.035670 17024 server_base.cc:1034] running on GCE node
I20260619 04:39:56.036281 17024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:56.037182 17024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:56.038333 17024 hybrid_clock.cc:648] HybridClock initialized: now 1781843996038279 us; error 46 us; skew 500 ppm
I20260619 04:39:56.038658 17024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:56.042017 17024 init.cc:377] Logged in from keytab as oryx/127.9.224.65@KRBTEST.COM (short username oryx)
I20260619 04:39:56.043558 17024 webserver.cc:460] Webserver started at http://127.9.224.65:43653/ using document root <none> and password file <none>
I20260619 04:39:56.044275 17024 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:56.044402 17024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:56.049851 17024 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.002s
I20260619 04:39:56.052840 17101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:56.054463 17024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:39:56.054674 17024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "76f39354b4bd4cc58e739ba871d6b62c"
format_stamp: "Formatted at 2026-06-19 04:39:52 on dist-test-slave-9dgf"
server_key: "e2d42689498fbd7fa5f9833e95e02363"
server_key_iv: "c6bb1bf7e3dc21a25a0b2e48d4209318"
server_key_version: "encryptionkey@0"
I20260619 04:39:56.055754 17024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:56.069185 17024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:56.073788 17024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:56.074098 17024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:56.074740 17106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.068881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57194)
0619 04:39:56.069336 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.069360 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.069518 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.070009 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.070014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.070045 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:56.070283 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.070302 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.071529 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.071534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.072726 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.072738 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.073854 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.073860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.074043 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.074082 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.074203 (+ 121us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.074378 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":242,"threads_started":1}
I20260619 04:39:56.074749 17107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.069034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.9.224.124:33397)
0619 04:39:56.069709 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.069714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.069729 (+ 15us) server_negotiation.cc:407] Connection header received
0619 04:39:56.069788 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.069792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.069855 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.069990 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:56.070429 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.071381 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.072876 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.073667 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.073821 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.074040 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.074244 (+ 204us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.074377 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":411,"threads_started":1}
I20260619 04:39:56.075405 17024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:56.075866 17047 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260619 04:39:56.076593 17075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1109aa8588fb4702833e5d1cb37c5a84. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:56.076896 17075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: This master's current role is: LEARNER
I20260619 04:39:56.077214 17024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:56.077299 17024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:56.077437 17024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:56.077525 17024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:56.112668 17024 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:38257
I20260619 04:39:56.112777 17215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:38257 every 8 connection(s)
I20260619 04:39:56.114212 17024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:39:56.121877 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 17024
I20260619 04:39:56.122305 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16440
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.124@KRBTEST.COM
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.66@KRBTEST.COM
I20260619 04:39:56.144466 17107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.117481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:44895 (local address 127.9.224.124:33397)
0619 04:39:56.117678 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.117684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.119096 (+ 1412us) server_negotiation.cc:407] Connection header received
0619 04:39:56.121299 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.121308 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.121400 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.121473 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.125741 (+ 4268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.126806 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.129121 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.129782 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.129901 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.135881 (+ 5980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.135886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.135890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.135923 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.140255 (+ 4332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.141486 (+ 1231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.141491 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.141494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.141637 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.142248 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.142253 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.142257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.142600 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.142729 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.143859 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.144086 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 04:39:56.144563 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.117188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:51111 (local address 127.9.224.126:36341)
0619 04:39:56.118029 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.118041 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.119192 (+ 1151us) server_negotiation.cc:407] Connection header received
0619 04:39:56.121395 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.121400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.121480 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.121574 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.126031 (+ 4457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.127223 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.129272 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.129909 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.130004 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.137338 (+ 7334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.137346 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.137350 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.137398 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.141165 (+ 3767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.142095 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.142105 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.142109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.142289 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.142751 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.142755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.142758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.143111 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.143235 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.143881 (+ 646us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.144114 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":710,"threads_started":1}
I20260619 04:39:56.145877 17224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.117887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.9.224.65:56559)
0619 04:39:56.122868 (+ 4981us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.122886 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.123005 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.123638 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.123645 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.124440 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:56.125043 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.125070 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.126567 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.126573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.128939 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.128956 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.130260 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.130268 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.130719 (+ 451us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.131865 (+ 1146us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:56.131883 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:56.136188 (+ 4305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:56.140436 (+ 4248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.140447 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.140469 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.141334 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.141785 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.141790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.141794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.142083 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.142817 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:56.142825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:56.143387 (+ 562us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.143761 (+ 374us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.144320 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4844,"mutex_wait_us":964,"spinlock_wait_cycles":19968,"thread_start_us":3987,"threads_started":1}
I20260619 04:39:56.146123 17223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.117877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:51111)
0619 04:39:56.119106 (+ 1229us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.119122 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.120937 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.121962 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.121975 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.123721 (+ 1746us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:56.125837 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.125850 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.127435 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.127442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.129104 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.129117 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.130317 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.130323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.130717 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.131693 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:56.131731 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:56.137030 (+ 5299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:56.141332 (+ 4302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.141338 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.141342 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.141935 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.142449 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.142454 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.142457 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.142611 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.143332 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:56.143336 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:56.143517 (+ 181us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.145184 (+ 1667us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.145536 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":961,"spinlock_wait_cycles":17664,"thread_start_us":533,"threads_started":1}
I20260619 04:39:56.146327 17221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.117877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.9.224.65:44895)
0619 04:39:56.118899 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.118961 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.120937 (+ 1976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.121963 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.121975 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.125196 (+ 3221us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:56.125554 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.125567 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.126978 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.126983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.128940 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.128956 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.130260 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.130268 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.130707 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.131744 (+ 1037us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:56.131775 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:56.135615 (+ 3840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:56.140436 (+ 4821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.140447 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.140469 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.141334 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.141785 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.141790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.141794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.142083 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.142817 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:56.142825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:56.143387 (+ 562us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.145098 (+ 1711us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.145391 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":199,"spinlock_wait_cycles":79232,"thread_start_us":388,"threads_started":1}
I20260619 04:39:56.146543 17222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.118132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:56559 (local address 127.9.224.125:44335)
0619 04:39:56.118614 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.118619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.123001 (+ 4382us) server_negotiation.cc:407] Connection header received
0619 04:39:56.123114 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.123119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.123254 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.123374 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.125241 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.126387 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.129129 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.129808 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.129915 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.136420 (+ 6505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.136428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.136435 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.136487 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.140261 (+ 3774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.141497 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.141503 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.141506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.141637 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.142218 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.142223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.142248 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.142605 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.142746 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.145876 (+ 3130us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.146121 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":684,"threads_started":1}
I20260619 04:39:56.148067 17217 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36341
I20260619 04:39:56.148115 17216 heartbeater.cc:347] Connected to a master server at 127.9.224.124:33397
I20260619 04:39:56.148195 17218 heartbeater.cc:347] Connected to a master server at 127.9.224.125:44335
I20260619 04:39:56.148442 17218 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:56.148469 17216 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:56.148455 17217 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:56.148869 17226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.123410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.9.224.66:40411)
0619 04:39:56.125704 (+ 2294us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.125716 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.125750 (+ 34us) server_negotiation.cc:407] Connection header received
0619 04:39:56.126052 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.126062 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.126363 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.126510 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.129086 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.130659 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.132497 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.133381 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.133534 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.139648 (+ 6114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.139668 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.139687 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.139737 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.143642 (+ 3905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.144735 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.144745 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.144748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.144909 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.145368 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.145373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.145378 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.145785 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.146072 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.147432 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.147713 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2110,"thread_start_us":1951,"threads_started":1}
I20260619 04:39:56.149574 17216 heartbeater.cc:511] Master 127.9.224.124:33397 requested a full tablet report, sending...
I20260619 04:39:56.149616 17217 heartbeater.cc:511] Master 127.9.224.126:36341 requested a full tablet report, sending...
I20260619 04:39:56.149642 17218 heartbeater.cc:511] Master 127.9.224.125:44335 requested a full tablet report, sending...
I20260619 04:39:56.150553 16563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:56.152190 17037 ts_manager.cc:194] Registered new tserver with Master: 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257)
I20260619 04:39:56.152184 16846 ts_manager.cc:194] Registered new tserver with Master: 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257)
I20260619 04:39:56.154035 16245 ts_manager.cc:194] Re-registered known tserver with Master: 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257)
I20260619 04:39:56.155594 16245 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:51111
I20260619 04:39:56.240375 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16440
I20260619 04:39:56.257098 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:40411
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:36341
--webserver_port=45183
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:39:56.524861 16966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: NON_VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: true } } }
I20260619 04:39:56.525296 16966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:56.526952 17229 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: attempting to promote NON_VOTER 0f56af58a57147c486ecf66d50bd287b to VOTER
I20260619 04:39:56.527592 17229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } }
I20260619 04:39:56.529805 17047 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 LEARNER]: Refusing update from remote peer 1109aa8588fb4702833e5d1cb37c5a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260619 04:39:56.529845 16856 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Refusing update from remote peer 1109aa8588fb4702833e5d1cb37c5a84: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260619 04:39:56.530493 17230 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260619 04:39:56.530951 16966 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260619 04:39:56.534612 17230 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0f56af58a57147c486ecf66d50bd287b (127.9.224.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.535547 17047 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0f56af58a57147c486ecf66d50bd287b (127.9.224.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.538177 17230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.538501 17230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:56.538053 16856 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0f56af58a57147c486ecf66d50bd287b (127.9.224.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.538771 16966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.539021 16966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:56.539259 16966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.539510 16966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:56.540793 17075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.541062 17075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:39:56.542567 17235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1109aa8588fb4702833e5d1cb37c5a84" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:56.542960 17235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: FOLLOWER
W20260619 04:39:56.606654 17228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:56.606957 17228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:56.607152 17228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:56.614881 17228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:56.615018 17228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:56.615231 17228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:39:56.625815 17228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:40411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=45183
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:56.627373 17228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:56.628952 17228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:56.642992 17240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:56.643044 17241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:56.643044 17243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:56.643977 17228 server_base.cc:1034] running on GCE node
I20260619 04:39:56.644735 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:56.645762 17228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:56.646992 17228 hybrid_clock.cc:648] HybridClock initialized: now 1781843996646923 us; error 64 us; skew 500 ppm
I20260619 04:39:56.647356 17228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:56.651182 17228 init.cc:377] Logged in from keytab as oryx/127.9.224.66@KRBTEST.COM (short username oryx)
I20260619 04:39:56.652990 17228 webserver.cc:460] Webserver started at http://127.9.224.66:45183/ using document root <none> and password file <none>
I20260619 04:39:56.653925 17228 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:56.654068 17228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:56.661586 17228 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.002s
I20260619 04:39:56.665216 17250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:56.667074 17228 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260619 04:39:56.667285 17228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "307fcf7f5fad46ba80a2999aef1b9393"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "9d51102f436e0d1865fe261ba0839204"
server_key_iv: "56a1f0ca7b5d2b36527cd607e47ba4a4"
server_key_version: "encryptionkey@0"
I20260619 04:39:56.668351 17228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:56.687203 17228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:56.691854 17228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:56.692164 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:56.693212 17228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:56.694833 17228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:56.694952 17228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:56.695099 17228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:56.695200 17228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:56.728978 17228 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:40411
I20260619 04:39:56.729027 17362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:40411 every 8 connection(s)
I20260619 04:39:56.730605 17228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:39:56.731467 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 17228
I20260619 04:39:56.731752 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16573
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.124@KRBTEST.COM
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843996, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
I20260619 04:39:56.787591 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.733874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:45145 (local address 127.9.224.124:33397)
0619 04:39:56.762538 (+ 28664us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.762547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.762573 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:39:56.762653 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.762662 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.762767 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.762894 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.766092 (+ 3198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.767485 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.770753 (+ 3268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.771677 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.771831 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.778196 (+ 6365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.778204 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.778209 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.778299 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.781903 (+ 3604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.783016 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.783023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.783029 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.783182 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.783753 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.783760 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.783765 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.784175 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.784338 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.786884 (+ 2546us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.787140 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28439,"thread_start_us":31982,"threads_started":1}
I20260619 04:39:56.790166 17371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.734551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.9.224.66:45145)
0619 04:39:56.751509 (+ 16958us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.751592 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.760746 (+ 9154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.763524 (+ 2778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.763543 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.764630 (+ 1087us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:56.765670 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.765704 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.767727 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.767735 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.770492 (+ 2757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.770519 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.772256 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.772266 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.772683 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.773735 (+ 1052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:56.773769 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:56.777876 (+ 4107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:56.782083 (+ 4207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.782093 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.782113 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.782834 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.783325 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.783329 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.783334 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.783604 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.784372 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:56.784380 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:56.784744 (+ 364us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.785759 (+ 1015us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.788350 (+ 2591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16519,"thread_start_us":39824,"threads_started":1}
Jun 19 04:39:56 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.67@KRBTEST.COM
I20260619 04:39:56.792097 17363 heartbeater.cc:347] Connected to a master server at 127.9.224.124:33397
I20260619 04:39:56.792465 17363 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:56.793419 17363 heartbeater.cc:511] Master 127.9.224.124:33397 requested a full tablet report, sending...
I20260619 04:39:56.795738 17037 ts_manager.cc:194] Registered new tserver with Master: 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:56.796514 17372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.735384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:53079 (local address 127.9.224.126:36341)
0619 04:39:56.768690 (+ 33306us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.768697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.776031 (+ 7334us) server_negotiation.cc:407] Connection header received
0619 04:39:56.776151 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.776155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.776222 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.776353 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.777686 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.778730 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.780799 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.781476 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.781618 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.785916 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.785924 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.785929 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.785969 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.789596 (+ 3627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.791972 (+ 2376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.791978 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.791981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.792173 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.793284 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.793290 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.793293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.793679 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.793829 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.795736 (+ 1907us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.796090 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33158,"thread_start_us":33312,"threads_started":1}
I20260619 04:39:56.796515 17373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.734964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.9.224.66:50251)
0619 04:39:56.754841 (+ 19877us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.754869 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.759416 (+ 4547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.774624 (+ 15208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.774630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.775328 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:56.775777 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.775797 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.779919 (+ 4122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.779924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.781795 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.781809 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.783147 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.783158 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.783357 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.784000 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:56.784024 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:56.786789 (+ 2765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:56.793412 (+ 6623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.793419 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.793423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.794035 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.794573 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.794580 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.794584 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.794739 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.795398 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:56.795403 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:56.795577 (+ 174us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.795730 (+ 153us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.796018 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19680,"mutex_wait_us":3,"thread_start_us":15932,"threads_started":1}
I20260619 04:39:56.797501 17369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.734763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:50251 (local address 127.9.224.125:44335)
0619 04:39:56.774174 (+ 39411us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.774181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.774203 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:39:56.774291 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.774297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.774397 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.776669 (+ 2272us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.778149 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.779744 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.781991 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.782905 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.785506 (+ 2601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.787011 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.787018 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.787025 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.787194 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.793246 (+ 6052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.794246 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.794254 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.794261 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.794412 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.794885 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.794889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.794892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.795264 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.796771 (+ 1507us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.796894 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.797150 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39271,"thread_start_us":39154,"threads_started":1}
I20260619 04:39:56.797911 17370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.735539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:53079)
0619 04:39:56.774878 (+ 39339us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:56.774916 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:56.775106 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:56.776373 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:56.776377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:56.776931 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:56.777297 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.777308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.778928 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.778936 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.780602 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:56.780620 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.781898 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.781905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:56.782088 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.782805 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:56.782828 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:56.785668 (+ 2840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:56.789737 (+ 4069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.789745 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.789748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.791772 (+ 2024us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.792303 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:56.792309 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:56.792314 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:56.792497 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:56.795056 (+ 2559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:56.795061 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:56.795259 (+ 198us) client_negotiation.cc:769] Sending connection context
0619 04:39:56.795398 (+ 139us) client_negotiation.cc:240] Negotiation successful
0619 04:39:56.797353 (+ 1955us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39154,"mutex_wait_us":1641,"spinlock_wait_cycles":27904,"thread_start_us":18880,"threads_started":1}
I20260619 04:39:56.798462 17365 heartbeater.cc:347] Connected to a master server at 127.9.224.125:44335
I20260619 04:39:56.798614 17365 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:56.799103 17365 heartbeater.cc:511] Master 127.9.224.125:44335 requested a full tablet report, sending...
I20260619 04:39:56.799525 17364 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36341
I20260619 04:39:56.799643 17364 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:56.800088 17364 heartbeater.cc:511] Master 127.9.224.126:36341 requested a full tablet report, sending...
I20260619 04:39:56.800395 16846 ts_manager.cc:194] Registered new tserver with Master: 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:56.801048 16245 ts_manager.cc:194] Re-registered known tserver with Master: 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:56.801079 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:56.732939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40876 (local address 127.9.224.67:34829)
0619 04:39:56.773767 (+ 40828us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:56.773777 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:56.776545 (+ 2768us) server_negotiation.cc:407] Connection header received
0619 04:39:56.776954 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:56.776966 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:56.777290 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:56.777455 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:56.779602 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.781238 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.783139 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:56.784199 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:56.785209 (+ 1010us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:56.792430 (+ 7221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:56.792448 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:56.792467 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:56.792528 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:56.797310 (+ 4782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.798267 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.798277 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.798281 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.798450 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:56.799005 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:56.799009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:56.799011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:56.799392 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:56.799701 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:56.800204 (+ 503us) server_negotiation.cc:299] Negotiation successful
0619 04:39:56.800546 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40607,"thread_start_us":41172,"threads_started":1}
I20260619 04:39:56.802052 16245 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:53079
I20260619 04:39:56.802759 16696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:56.889914 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16573
I20260619 04:39:56.907598 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:34829
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:36341
--webserver_port=41963
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:39:57.159848 17217 heartbeater.cc:503] Master 127.9.224.126:36341 was elected leader, sending a full tablet report...
W20260619 04:39:57.251693 17376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:39:57.252089 17376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:39:57.252230 17376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:39:57.263599 17376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:39:57.263718 17376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:39:57.263837 17376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:39:57.274132 17376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:34829
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=41963
--tserver_master_addrs=127.9.224.126:36341,127.9.224.125:44335,127.9.224.124:33397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:39:57.275524 17376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:39:57.276844 17376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:39:57.291074 17381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:57.291038 17384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:39:57.291319 17382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:39:57.292039 17376 server_base.cc:1034] running on GCE node
I20260619 04:39:57.292662 17376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:39:57.293620 17376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:39:57.294842 17376 hybrid_clock.cc:648] HybridClock initialized: now 1781843997294790 us; error 48 us; skew 500 ppm
I20260619 04:39:57.295225 17376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:39:57 dist-test-slave-9dgf krb5kdc[16200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843997, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:39:57.299031 17376 init.cc:377] Logged in from keytab as oryx/127.9.224.67@KRBTEST.COM (short username oryx)
I20260619 04:39:57.300562 17376 webserver.cc:460] Webserver started at http://127.9.224.67:41963/ using document root <none> and password file <none>
I20260619 04:39:57.301513 17376 fs_manager.cc:359] Metadata directory not provided
I20260619 04:39:57.301705 17376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:39:57.307548 17376 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260619 04:39:57.310647 17391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:57.312104 17376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:39:57.312245 17376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "fa16815172824caaa0c6dbb8ce9b7c4f"
format_stamp: "Formatted at 2026-06-19 04:39:53 on dist-test-slave-9dgf"
server_key: "849c632cbd415ef5d93a318a3f450197"
server_key_iv: "dbeea4350a1ae605561240ba51f1790b"
server_key_version: "encryptionkey@0"
I20260619 04:39:57.313192 17376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:39:57.345647 17376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:39:57.350275 17376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:39:57.350519 17376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:39:57.351542 17376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:39:57.352875 17376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:39:57.352963 17376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:57.353046 17376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:39:57.353099 17376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:39:57.387328 17376 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:34829
I20260619 04:39:57.387430 17503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:34829 every 8 connection(s)
I20260619 04:39:57.388921 17376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:39:57.390144 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 17376
Jun 19 04:39:57 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843997, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.125@KRBTEST.COM
Jun 19 04:39:57 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843997, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.124@KRBTEST.COM
Jun 19 04:39:57 dist-test-slave-9dgf krb5kdc[16200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781843997, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:39:57.462361 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.393405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:60227 (local address 127.9.224.125:44335)
0619 04:39:57.407494 (+ 14089us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.407503 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.408439 (+ 936us) server_negotiation.cc:407] Connection header received
0619 04:39:57.412698 (+ 4259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.412704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.412792 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.412896 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.415919 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.417484 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.429135 (+ 11651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.429839 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.429966 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.448686 (+ 18720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.448694 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.448699 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.448772 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.453030 (+ 4258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.458088 (+ 5058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.458094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.458108 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.458314 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.460529 (+ 2215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.460535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.460538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.460910 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.461061 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.461629 (+ 568us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.461876 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13929,"thread_start_us":13813,"threads_started":1}
I20260619 04:39:57.464944 17512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.392720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.9.224.67:60227)
0619 04:39:57.408040 (+ 15320us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.408065 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.412142 (+ 4077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.413356 (+ 1214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.413370 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.414449 (+ 1079us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:57.415651 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.415686 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.417796 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.417805 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.422994 (+ 5189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.423017 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.430352 (+ 7335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.430359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.430719 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.440881 (+ 10162us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:57.440933 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:57.448341 (+ 7408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:57.457218 (+ 8877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:57.457223 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:57.457227 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:57.457957 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:57.460139 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:57.460144 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:57.460147 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:57.460385 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:57.461143 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:57.461148 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:57.461314 (+ 166us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.462660 (+ 1346us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.463254 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13112,"thread_start_us":34793,"threads_started":1}
I20260619 04:39:57.465505 17509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.391972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:41049 (local address 127.9.224.124:33397)
0619 04:39:57.404847 (+ 12875us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.404857 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.407057 (+ 2200us) server_negotiation.cc:407] Connection header received
0619 04:39:57.418478 (+ 11421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.418488 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.418617 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.418717 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.423239 (+ 4522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.424793 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.429177 (+ 4384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.429846 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.429950 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.452399 (+ 22449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.452408 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.452414 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.452461 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.456758 (+ 4297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.458306 (+ 1548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.458312 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.458314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.458459 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.459025 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.459030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.459033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.459384 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.459514 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.460567 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.460814 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12689,"thread_start_us":12899,"threads_started":1}
I20260619 04:39:57.467029 17506 heartbeater.cc:347] Connected to a master server at 127.9.224.125:44335
I20260619 04:39:57.467370 17510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.392010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:43267 (local address 127.9.224.126:36341)
0619 04:39:57.405392 (+ 13382us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.405401 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.428162 (+ 22761us) server_negotiation.cc:407] Connection header received
0619 04:39:57.429088 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.429097 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.429215 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.429386 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.431570 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.433223 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.440545 (+ 7322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.441513 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.441670 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.460183 (+ 18513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.460191 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.460196 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.460261 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.463780 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.464927 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.464933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.464938 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.465098 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.465787 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.465792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.465795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.466150 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.466336 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.466765 (+ 429us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.467008 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13191,"thread_start_us":13099,"threads_started":1}
I20260619 04:39:57.467394 17506 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:57.468369 17514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.392720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.9.224.67:41049)
0619 04:39:57.406797 (+ 14077us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.406882 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.418261 (+ 11379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.419008 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.419015 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.419689 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:57.420076 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.420092 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.425045 (+ 4953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.425053 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.427269 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.427288 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.431431 (+ 4143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.431438 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.431645 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.443113 (+ 11468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:57.443148 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:57.452106 (+ 8958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:57.456963 (+ 4857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:57.456976 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:57.457000 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:57.458130 (+ 1130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:57.458618 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:57.458625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:57.458630 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:57.458896 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:57.459623 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:57.459631 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:57.460098 (+ 467us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.466470 (+ 6372us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.467857 (+ 1387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13722,"mutex_wait_us":54,"spinlock_wait_cycles":77056,"thread_start_us":12829,"threads_started":1}
I20260619 04:39:57.468433 17506 heartbeater.cc:511] Master 127.9.224.125:44335 requested a full tablet report, sending...
I20260619 04:39:57.469275 17504 heartbeater.cc:347] Connected to a master server at 127.9.224.124:33397
I20260619 04:39:57.469412 17504 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:57.469914 17504 heartbeater.cc:511] Master 127.9.224.124:33397 requested a full tablet report, sending...
I20260619 04:39:57.470743 16846 ts_manager.cc:194] Registered new tserver with Master: fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67:34829)
I20260619 04:39:57.471009 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.427993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37740 (local address 127.9.224.125:44335)
0619 04:39:57.428551 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.428562 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.439409 (+ 10847us) server_negotiation.cc:407] Connection header received
0619 04:39:57.439509 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.439518 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.439636 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.439785 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.448336 (+ 8551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.450949 (+ 2613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.455897 (+ 4948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.456613 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.456749 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.461632 (+ 4883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.461639 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.461643 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.461671 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.466630 (+ 4959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.467523 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.467532 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.467536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.467707 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.468151 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.468156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.468159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.468890 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.469139 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.470339 (+ 1200us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.470574 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":265,"threads_started":1}
I20260619 04:39:57.471067 17037 ts_manager.cc:194] Registered new tserver with Master: fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67:34829)
I20260619 04:39:57.472643 17511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.393894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:43267)
0619 04:39:57.428025 (+ 34131us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.428054 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.428912 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.430161 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.430166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.430820 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:39:57.431181 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.431196 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.438090 (+ 6894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.438100 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.440332 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.440357 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.448799 (+ 8442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.448806 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.449033 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.450000 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:39:57.450025 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:39:57.459967 (+ 9942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:39:57.463923 (+ 3956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:57.463930 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:57.463935 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:57.464525 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:57.465366 (+ 841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:39:57.465372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:39:57.465375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:39:57.465542 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:39:57.466305 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:39:57.466313 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:39:57.466471 (+ 158us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.466615 (+ 144us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.466895 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33938,"thread_start_us":13071,"threads_started":1}
I20260619 04:39:57.473505 17505 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36341
I20260619 04:39:57.473649 17505 heartbeater.cc:464] Registering TS with master...
I20260619 04:39:57.474071 17505 heartbeater.cc:511] Master 127.9.224.126:36341 requested a full tablet report, sending...
I20260619 04:39:57.475173 16245 ts_manager.cc:194] Re-registered known tserver with Master: fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67:34829)
I20260619 04:39:57.475912 17523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.433487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60946 (local address 127.9.224.126:36341)
0619 04:39:57.454375 (+ 20888us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.454381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.455421 (+ 1040us) server_negotiation.cc:407] Connection header received
0619 04:39:57.455636 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.455642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.455733 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.455846 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.458979 (+ 3133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.460079 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.462005 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.462801 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.462951 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.468253 (+ 5302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.468262 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.468269 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.468304 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.472086 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.473296 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.473302 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.473306 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.473488 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.473939 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.473944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.473948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.474334 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.474626 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.475263 (+ 637us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.475516 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20707,"thread_start_us":20554,"threads_started":1}
I20260619 04:39:57.476437 16245 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:43267
I20260619 04:39:57.486908 17521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.432177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57200 (local address 127.9.224.124:33397)
0619 04:39:57.454599 (+ 22422us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.454608 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.455091 (+ 483us) server_negotiation.cc:407] Connection header received
0619 04:39:57.455828 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.455836 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.455942 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.456022 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.473557 (+ 17535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.474825 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.476604 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.477181 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.477304 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.480556 (+ 3252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.480563 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.480568 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.480612 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.484008 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.484726 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.484731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.484735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.484886 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.485348 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.485353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.485356 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.485659 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.485907 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.486317 (+ 410us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.486535 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22239,"thread_start_us":24870,"threads_started":1}
I20260619 04:39:57.480139 16244 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:57.489693 16244 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:57.521098 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.512019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39684 (local address 127.9.224.66:40411)
0619 04:39:57.512475 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.512486 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.512516 (+ 30us) server_negotiation.cc:407] Connection header received
0619 04:39:57.512617 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.512625 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.512918 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.513764 (+ 846us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:57.514460 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.515995 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.518977 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.519925 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.520091 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.520337 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.520655 (+ 318us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.520824 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":297,"threads_started":1}
I20260619 04:39:57.521456 17534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.511445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40411 (local address 127.0.0.1:39684)
0619 04:39:57.512140 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.512164 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.512304 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.513699 (+ 1395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.513704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.513729 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:57.514145 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.514159 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.516187 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.516192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.518816 (+ 2624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.518831 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.520180 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.520186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.520454 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.520483 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.520597 (+ 114us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.520738 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":47,"thread_start_us":708,"threads_started":1}
I20260619 04:39:57.523732 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.513171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34829 (local address 127.0.0.1:40892)
0619 04:39:57.514871 (+ 1700us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.514888 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.515010 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.515652 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.515657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.515681 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:57.516080 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.516091 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.518364 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.518373 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.520826 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.520847 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.522853 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.522859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.523050 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.523085 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.523196 (+ 111us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.523327 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1591,"mutex_wait_us":63,"thread_start_us":1466,"threads_started":1}
I20260619 04:39:57.523808 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.513736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40892 (local address 127.9.224.67:34829)
0619 04:39:57.514460 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.514469 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.515004 (+ 535us) server_negotiation.cc:407] Connection header received
0619 04:39:57.515159 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.515171 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.515462 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.515674 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:57.516746 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.518211 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.521101 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.522654 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.522802 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.523005 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.523253 (+ 248us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.523416 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":352,"threads_started":1}
I20260619 04:39:57.525128 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.511296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53130 (local address 127.9.224.65:38257)
0619 04:39:57.515502 (+ 4206us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.515510 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.515537 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:39:57.515635 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.515642 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.515870 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.516068 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:57.516733 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.518457 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.521053 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.523713 (+ 2660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.524238 (+ 525us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.524452 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.524659 (+ 207us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.524824 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4031,"thread_start_us":3909,"threads_started":1}
I20260619 04:39:57.525671 17298 tablet_service.cc:1467] Processing CreateTablet for tablet 746d5d7b652f4fa9834b2cc783fcfa56 (DEFAULT_TABLE table=test-table [id=29ae9f0a2e6f404bb893cdef40919370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:57.526697 17532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.511001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:38257 (local address 127.0.0.1:53130)
0619 04:39:57.511643 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.511666 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.511801 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.516072 (+ 4271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.516076 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.516099 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:57.516564 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.516579 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.518607 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.518617 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.520934 (+ 2317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.520946 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.524278 (+ 3332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.524284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.524457 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.524502 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.524614 (+ 112us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.524748 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":69,"thread_start_us":312,"threads_started":1}
I20260619 04:39:57.527387 17298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 746d5d7b652f4fa9834b2cc783fcfa56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:57.527320 17439 tablet_service.cc:1467] Processing CreateTablet for tablet 746d5d7b652f4fa9834b2cc783fcfa56 (DEFAULT_TABLE table=test-table [id=29ae9f0a2e6f404bb893cdef40919370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:57.528638 17439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 746d5d7b652f4fa9834b2cc783fcfa56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:57.530757 17151 tablet_service.cc:1467] Processing CreateTablet for tablet 746d5d7b652f4fa9834b2cc783fcfa56 (DEFAULT_TABLE table=test-table [id=29ae9f0a2e6f404bb893cdef40919370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:57.532096 17151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 746d5d7b652f4fa9834b2cc783fcfa56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:57.542470 17538 tablet_bootstrap.cc:492] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Bootstrap starting.
I20260619 04:39:57.545712 17538 tablet_bootstrap.cc:654] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:57.546651 17539 tablet_bootstrap.cc:492] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Bootstrap starting.
I20260619 04:39:57.547149 17538 log.cc:824] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:57.549161 17541 tablet_bootstrap.cc:492] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Bootstrap starting.
I20260619 04:39:57.550635 17538 tablet_bootstrap.cc:492] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: No bootstrap required, opened a new log
I20260619 04:39:57.550779 17539 tablet_bootstrap.cc:654] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:57.550961 17538 ts_tablet_manager.cc:1397] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 04:39:57.552080 17539 log.cc:824] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:57.553645 17541 tablet_bootstrap.cc:654] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:57.554915 17541 log.cc:824] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:39:57.555263 17539 tablet_bootstrap.cc:492] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: No bootstrap required, opened a new log
I20260619 04:39:57.555584 17539 ts_tablet_manager.cc:1397] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 04:39:57.558811 17538 raft_consensus.cc:348] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.559373 17538 raft_consensus.cc:374] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:57.559475 17538 raft_consensus.cc:729] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa16815172824caaa0c6dbb8ce9b7c4f, State: Initialized, Role: FOLLOWER
I20260619 04:39:57.560122 17538 consensus_queue.cc:260] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.561434 17541 tablet_bootstrap.cc:492] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: No bootstrap required, opened a new log
I20260619 04:39:57.561767 17541 ts_tablet_manager.cc:1397] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260619 04:39:57.562791 17505 heartbeater.cc:503] Master 127.9.224.126:36341 was elected leader, sending a full tablet report...
I20260619 04:39:57.563558 17538 ts_tablet_manager.cc:1428] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260619 04:39:57.569011 17539 raft_consensus.cc:348] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.569492 17539 raft_consensus.cc:374] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:57.569617 17539 raft_consensus.cc:729] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307fcf7f5fad46ba80a2999aef1b9393, State: Initialized, Role: FOLLOWER
I20260619 04:39:57.570345 17539 consensus_queue.cc:260] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.571431 17364 heartbeater.cc:503] Master 127.9.224.126:36341 was elected leader, sending a full tablet report...
I20260619 04:39:57.571208 17541 raft_consensus.cc:348] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.571668 17541 raft_consensus.cc:374] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:57.571760 17541 raft_consensus.cc:729] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f39354b4bd4cc58e739ba871d6b62c, State: Initialized, Role: FOLLOWER
I20260619 04:39:57.572163 17539 ts_tablet_manager.cc:1428] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Time spent starting tablet: real 0.016s user 0.010s sys 0.003s
I20260619 04:39:57.572904 17541 consensus_queue.cc:260] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.578326 17541 ts_tablet_manager.cc:1428] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260619 04:39:57.586501 17544 raft_consensus.cc:482] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:57.586823 17544 raft_consensus.cc:504] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.588534 17544 leader_election.cc:288] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257), 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:57.596747 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.588872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:55859 (local address 127.9.224.65:38257)
0619 04:39:57.589090 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.589096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.589352 (+ 256us) server_negotiation.cc:407] Connection header received
0619 04:39:57.589537 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.589544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.589620 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.589713 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:57.590129 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.591292 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.594154 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.595532 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.595684 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.595760 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.596330 (+ 570us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.596465 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 04:39:57.596750 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.589069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:54491 (local address 127.9.224.66:40411)
0619 04:39:57.589324 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.589329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.589344 (+ 15us) server_negotiation.cc:407] Connection header received
0619 04:39:57.589406 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.589409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.589466 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.589575 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:57.589990 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.591292 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.594154 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.595514 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.595686 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.595760 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.596330 (+ 570us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.596465 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260619 04:39:57.596848 17511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.588790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40411 (local address 127.9.224.67:54491)
0619 04:39:57.588989 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.589011 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.589144 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.589613 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.589618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.589652 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:57.589845 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.589853 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.591458 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.591464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.593962 (+ 2498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.593979 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.595719 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.595726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.596046 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.596176 (+ 130us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.596277 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.596513 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":316}
I20260619 04:39:57.596854 17514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.588930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:38257 (local address 127.9.224.67:55859)
0619 04:39:57.589255 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:57.589270 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:57.589391 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:57.589759 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:57.589765 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:57.589794 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:57.589991 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.590000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.591458 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.591464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.593969 (+ 2505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:57.593979 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.595719 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.595726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:57.596048 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.596175 (+ 127us) client_negotiation.cc:769] Sending connection context
0619 04:39:57.596277 (+ 102us) client_negotiation.cc:240] Negotiation successful
0619 04:39:57.596544 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":359}
I20260619 04:39:57.597905 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746d5d7b652f4fa9834b2cc783fcfa56" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307fcf7f5fad46ba80a2999aef1b9393" is_pre_election: true
I20260619 04:39:57.597918 17171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746d5d7b652f4fa9834b2cc783fcfa56" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f39354b4bd4cc58e739ba871d6b62c" is_pre_election: true
I20260619 04:39:57.598443 17171 raft_consensus.cc:2454] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 0.
I20260619 04:39:57.598436 17318 raft_consensus.cc:2454] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 0.
I20260619 04:39:57.599107 17395 leader_election.cc:302] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 307fcf7f5fad46ba80a2999aef1b9393, fa16815172824caaa0c6dbb8ce9b7c4f; no voters:
I20260619 04:39:57.599524 17544 raft_consensus.cc:2781] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:57.599678 17544 raft_consensus.cc:482] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:57.599783 17544 raft_consensus.cc:3037] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:57.602494 17544 raft_consensus.cc:504] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.603093 17544 leader_election.cc:288] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 election: Requested vote from peers 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257), 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:57.603619 17171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746d5d7b652f4fa9834b2cc783fcfa56" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f39354b4bd4cc58e739ba871d6b62c"
I20260619 04:39:57.603808 17171 raft_consensus.cc:3037] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:57.603722 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746d5d7b652f4fa9834b2cc783fcfa56" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307fcf7f5fad46ba80a2999aef1b9393"
I20260619 04:39:57.603979 17318 raft_consensus.cc:3037] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:57.605969 17171 raft_consensus.cc:2454] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 1.
I20260619 04:39:57.606326 17318 raft_consensus.cc:2454] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 1.
I20260619 04:39:57.606422 17394 leader_election.cc:302] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f39354b4bd4cc58e739ba871d6b62c, fa16815172824caaa0c6dbb8ce9b7c4f; no voters:
I20260619 04:39:57.606776 17544 raft_consensus.cc:2781] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:57.607244 17544 raft_consensus.cc:686] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 LEADER]: Becoming Leader. State: Replica: fa16815172824caaa0c6dbb8ce9b7c4f, State: Running, Role: LEADER
I20260619 04:39:57.607801 17544 consensus_queue.cc:237] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:57.612955 16244 catalog_manager.cc:5495] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f reported cstate change: term changed from 0 to 1, leader changed from <none> to fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67). New cstate: current_term: 1 leader_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } health_report { overall_health: HEALTHY } } }
W20260619 04:39:57.618260 17219 tablet.cc:2369] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:57.647648 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.642619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40894 (local address 127.9.224.67:34829)
0619 04:39:57.642843 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.642848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.642865 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:39:57.643037 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.643041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.643125 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.643251 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:57.643561 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.644290 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.645532 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.645976 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.646067 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.646569 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:57.647080 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:57.647203 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.647276 (+ 73us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.647342 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:39:57.656608 17171 raft_consensus.cc:1261] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Refusing update from remote peer fa16815172824caaa0c6dbb8ce9b7c4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:57.656628 17318 raft_consensus.cc:1261] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Refusing update from remote peer fa16815172824caaa0c6dbb8ce9b7c4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:57.657671 17544 consensus_queue.cc:1035] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:57.658005 17547 consensus_queue.cc:1035] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:57.675951 17552 mvcc.cc:205] Tried to move back new op lower bound from 7298433014389919744 to 7298433014205337600. Current Snapshot: MvccSnapshot[applied={T|T < 7298433014389919744}]
I20260619 04:39:57.679275 17551 mvcc.cc:205] Tried to move back new op lower bound from 7298433014389919744 to 7298433014205337600. Current Snapshot: MvccSnapshot[applied={T|T < 7298433014389919744}]
I20260619 04:39:57.696013 16244 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:57.696285 16244 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:57.703598 16244 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1109aa8588fb4702833e5d1cb37c5a84: Sending DeleteTablet for 3 replicas of tablet 746d5d7b652f4fa9834b2cc783fcfa56
I20260619 04:39:57.704830 17151 tablet_service.cc:1514] Processing DeleteTablet for tablet 746d5d7b652f4fa9834b2cc783fcfa56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:57 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:53130
I20260619 04:39:57.704866 17298 tablet_service.cc:1514] Processing DeleteTablet for tablet 746d5d7b652f4fa9834b2cc783fcfa56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:57 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:39684
I20260619 04:39:57.707175 17439 tablet_service.cc:1514] Processing DeleteTablet for tablet 746d5d7b652f4fa9834b2cc783fcfa56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:57 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:40892
I20260619 04:39:57.716550 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16213
I20260619 04:39:57.716843 17563 tablet_replica.cc:330] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: stopping tablet replica
I20260619 04:39:57.717408 17563 raft_consensus.cc:2229] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:57.717875 16275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:57.718300 17563 raft_consensus.cc:2258] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:57.721216 17562 tablet_replica.cc:330] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: stopping tablet replica
I20260619 04:39:57.721827 17562 raft_consensus.cc:2229] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:57.722731 17561 tablet_replica.cc:330] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: stopping tablet replica
I20260619 04:39:57.723178 17561 raft_consensus.cc:2229] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:57.723690 17561 raft_consensus.cc:2258] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:57.726752 17563 ts_tablet_manager.cc:1905] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:57.737169 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.713712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37746 (local address 127.9.224.125:44335)
0619 04:39:57.713986 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.713995 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.714883 (+ 888us) server_negotiation.cc:407] Connection header received
0619 04:39:57.716086 (+ 1203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.716092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.716179 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.716284 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.722136 (+ 5852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.723245 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.725404 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.726057 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.726173 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.729918 (+ 3745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.729924 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.729929 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.729977 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.733590 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.734598 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.734605 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.734609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.734762 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.735208 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.735214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.735217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.735553 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.735786 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.736568 (+ 782us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.736831 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 04:39:57.738590 17562 raft_consensus.cc:2258] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:57.743420 17561 ts_tablet_manager.cc:1905] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:57.748466 17562 ts_tablet_manager.cc:1905] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:57.757231 17521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.715940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57202 (local address 127.9.224.124:33397)
0619 04:39:57.716144 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.716150 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.739763 (+ 23613us) server_negotiation.cc:407] Connection header received
0619 04:39:57.740128 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.740134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.740229 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.740301 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.742171 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.743213 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.745115 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.745772 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.745877 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.749565 (+ 3688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.749591 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.749598 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.749644 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.753611 (+ 3967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.754660 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.754666 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.754672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.754831 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.755323 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.755329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.755332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.755718 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.755963 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.756569 (+ 606us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.756815 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 04:39:57.766944 17561 ts_tablet_manager.cc:1918] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:57.767156 17561 log.cc:1196] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/746d5d7b652f4fa9834b2cc783fcfa56
I20260619 04:39:57.767776 17561 ts_tablet_manager.cc:1939] T 746d5d7b652f4fa9834b2cc783fcfa56 P 307fcf7f5fad46ba80a2999aef1b9393: Deleting consensus metadata
I20260619 04:39:57.768603 17562 ts_tablet_manager.cc:1918] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:57.768782 17562 log.cc:1196] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/746d5d7b652f4fa9834b2cc783fcfa56
I20260619 04:39:57.769520 17562 ts_tablet_manager.cc:1939] T 746d5d7b652f4fa9834b2cc783fcfa56 P 76f39354b4bd4cc58e739ba871d6b62c: Deleting consensus metadata
I20260619 04:39:57.772858 17563 ts_tablet_manager.cc:1918] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:57.773067 17563 log.cc:1196] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/746d5d7b652f4fa9834b2cc783fcfa56
I20260619 04:39:57.773562 17563 ts_tablet_manager.cc:1939] T 746d5d7b652f4fa9834b2cc783fcfa56 P fa16815172824caaa0c6dbb8ce9b7c4f: Deleting consensus metadata
I20260619 04:39:57.901748 16229 catalog_manager.cc:4841] TS fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67:34829): tablet 746d5d7b652f4fa9834b2cc783fcfa56 (table test-table [id=29ae9f0a2e6f404bb893cdef40919370]) successfully deleted
I20260619 04:39:57.901667 16232 catalog_manager.cc:4841] TS 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411): tablet 746d5d7b652f4fa9834b2cc783fcfa56 (table test-table [id=29ae9f0a2e6f404bb893cdef40919370]) successfully deleted
I20260619 04:39:57.901693 16231 catalog_manager.cc:4841] TS 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257): tablet 746d5d7b652f4fa9834b2cc783fcfa56 (table test-table [id=29ae9f0a2e6f404bb893cdef40919370]) successfully deleted
I20260619 04:39:57.902613 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16213
I20260619 04:39:57.960369 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.931666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37760 (local address 127.9.224.125:44335)
0619 04:39:57.931859 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.931866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.942764 (+ 10898us) server_negotiation.cc:407] Connection header received
0619 04:39:57.944287 (+ 1523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.944295 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.944372 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.944469 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.946350 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.947310 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.949352 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.949790 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.949944 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.953073 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.953078 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.953082 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.953116 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.956948 (+ 3832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.957878 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.957885 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.957891 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.958040 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.958496 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.958501 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.958507 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.958898 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.959162 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.959726 (+ 564us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.959959 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:39:57.961218 17521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:57.931881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57206 (local address 127.9.224.124:33397)
0619 04:39:57.932118 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:57.932126 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:57.943459 (+ 11333us) server_negotiation.cc:407] Connection header received
0619 04:39:57.943839 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:57.943846 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:57.943981 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:57.944073 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:57.946886 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.947831 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.949384 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:57.950040 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:57.950166 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:57.953672 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:57.953681 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:57.953687 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:57.953738 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:57.957139 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.957922 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.957930 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.957937 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.958085 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:57.958551 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:57.958558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:57.958562 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:57.958899 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:57.959170 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:57.960609 (+ 1439us) server_negotiation.cc:299] Negotiation successful
0619 04:39:57.960836 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 04:39:58.681277 17573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:58.680353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:48601)
0619 04:39:58.680916 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:58.681079 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":281,"threads_started":1}
W20260619 04:39:58.681802 17505 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36341 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:58.685791 17574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:58.684931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:34533)
0619 04:39:58.685420 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:58.685572 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":218,"threads_started":1}
W20260619 04:39:58.686168 17217 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36341 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:58.691462 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:58.690419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:40649)
0619 04:39:58.691044 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:58.691248 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":378,"threads_started":1}
W20260619 04:39:58.691917 17364 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36341 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:59.204144 17576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1109aa8588fb4702833e5d1cb37c5a84)
I20260619 04:39:59.204511 17576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } }
I20260619 04:39:59.205900 17577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1109aa8588fb4702833e5d1cb37c5a84)
I20260619 04:39:59.206066 17576 leader_election.cc:288] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341), 0f56af58a57147c486ecf66d50bd287b (127.9.224.124:33397)
I20260619 04:39:59.206213 17577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } }
I20260619 04:39:59.208004 17577 leader_election.cc:288] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341), 922e5dad8ed14b91af83f22b748816f2 (127.9.224.125:44335)
I20260619 04:39:59.209448 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.206265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33096)
0619 04:39:59.208889 (+ 2624us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.209094 (+ 205us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2513,"threads_started":1}
I20260619 04:39:59.212221 17583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.209790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33112)
0619 04:39:59.211709 (+ 1919us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.211931 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1734,"thread_start_us":2040,"threads_started":1}
W20260619 04:39:59.212558 17023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
W20260619 04:39:59.213393 16833 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:59.214877 17583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.214472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33124)
0619 04:39:59.214676 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.214767 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260619 04:39:59.215109 17023 leader_election.cc:334] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341): Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:59.215843 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.215214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33132)
0619 04:39:59.215439 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.215645 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260619 04:39:59.216167 16833 leader_election.cc:334] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341): Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:59.217679 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.206324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33397 (local address 127.0.0.1:57214)
0619 04:39:59.209692 (+ 3368us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.209715 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:59.209940 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:59.210637 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:59.210644 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:59.210679 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:59.211047 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.211061 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.213182 (+ 2121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.213194 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.215447 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.215462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.216933 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.216940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.217130 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.217159 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 04:39:59.217295 (+ 136us) client_negotiation.cc:240] Negotiation successful
0619 04:39:59.217465 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3240,"thread_start_us":2319,"threads_started":1}
I20260619 04:39:59.217769 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.206627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.9.224.124:33397)
0619 04:39:59.208684 (+ 2057us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.208693 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.209820 (+ 1127us) server_negotiation.cc:407] Connection header received
0619 04:39:59.210130 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.210139 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.210252 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.210340 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:59.211258 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.212607 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.215607 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.216780 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.216882 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.216984 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.217311 (+ 327us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.217451 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":1903,"thread_start_us":1731,"threads_started":1}
I20260619 04:39:59.218441 17047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "922e5dad8ed14b91af83f22b748816f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0f56af58a57147c486ecf66d50bd287b" is_pre_election: true
I20260619 04:39:59.218816 17047 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e5dad8ed14b91af83f22b748816f2 in term 1.
I20260619 04:39:59.219295 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.208197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:44335 (local address 127.0.0.1:37776)
0619 04:39:59.209183 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.209206 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:59.209364 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:59.212217 (+ 2853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:59.212225 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:59.212265 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:59.212902 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.212917 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.215057 (+ 2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.215063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.216867 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.216884 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.218478 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.218482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.218610 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.218633 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 04:39:59.218736 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 04:39:59.218864 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"mutex_wait_us":146,"thread_start_us":651,"threads_started":1}
I20260619 04:39:59.219278 17582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.208904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37776 (local address 127.9.224.125:44335)
0619 04:39:59.211580 (+ 2676us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.211589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.211612 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:39:59.211684 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.211691 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.211779 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.212609 (+ 830us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:59.213519 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.214866 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.217049 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.218295 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.218428 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.218539 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.218812 (+ 273us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.218936 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2540,"thread_start_us":2350,"threads_started":1}
I20260619 04:39:59.219303 16830 leader_election.cc:302] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f56af58a57147c486ecf66d50bd287b, 922e5dad8ed14b91af83f22b748816f2; no voters: 1109aa8588fb4702833e5d1cb37c5a84
I20260619 04:39:59.219745 17576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 04:39:59.219868 17576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1109aa8588fb4702833e5d1cb37c5a84)
I20260619 04:39:59.219990 17576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 1 FOLLOWER]: Advancing to term 2
I20260619 04:39:59.220260 16856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f56af58a57147c486ecf66d50bd287b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "922e5dad8ed14b91af83f22b748816f2" is_pre_election: true
I20260619 04:39:59.222169 17576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } }
I20260619 04:39:59.222633 16856 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f56af58a57147c486ecf66d50bd287b in current term 2: Already voted for candidate 922e5dad8ed14b91af83f22b748816f2 in this term.
I20260619 04:39:59.222910 17576 leader_election.cc:288] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [CANDIDATE]: Term 2 election: Requested vote from peers 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341), 0f56af58a57147c486ecf66d50bd287b (127.9.224.124:33397)
I20260619 04:39:59.223480 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.223082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33138)
0619 04:39:59.223233 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.223325 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260619 04:39:59.223471 17047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "922e5dad8ed14b91af83f22b748816f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0f56af58a57147c486ecf66d50bd287b"
I20260619 04:39:59.223711 17047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 1 FOLLOWER]: Advancing to term 2
I20260619 04:39:59.223734 17021 leader_election.cc:302] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f56af58a57147c486ecf66d50bd287b; no voters: 1109aa8588fb4702833e5d1cb37c5a84, 922e5dad8ed14b91af83f22b748816f2
I20260619 04:39:59.225893 17047 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e5dad8ed14b91af83f22b748816f2 in term 2.
I20260619 04:39:59.226076 17577 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 04:39:59.226344 16830 leader_election.cc:302] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f56af58a57147c486ecf66d50bd287b, 922e5dad8ed14b91af83f22b748816f2; no voters:
I20260619 04:39:59.226663 17576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 04:39:59.227084 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.226623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33148)
0619 04:39:59.226785 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.226889 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260619 04:39:59.227202 17576 raft_consensus.cc:686] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [term 2 LEADER]: Becoming Leader. State: Replica: 922e5dad8ed14b91af83f22b748816f2, State: Running, Role: LEADER
W20260619 04:39:59.227324 16833 leader_election.cc:334] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341): Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
I20260619 04:39:59.227695 17576 consensus_queue.cc:237] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } }
I20260619 04:39:59.229697 17586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 922e5dad8ed14b91af83f22b748816f2. Latest consensus state: current_term: 2 leader_uuid: "922e5dad8ed14b91af83f22b748816f2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:59.230088 17586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:59.230774 17588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:39:59.234195 17588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:39:59.235013 17588 catalog_manager.cc:1259] Loaded cluster ID: c479dcb4caa64cf6a596a960a39512c2
I20260619 04:39:59.235116 17588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:39:59.236207 17588 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:39:59.237007 17588 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Loaded TSK: 0
I20260619 04:39:59.237834 17588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:39:59.253861 16846 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:39:59.261034 16846 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:39:59.265143 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.264743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33166)
0619 04:39:59.264920 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.265000 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 04:39:59.265194 17047 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [term 2 FOLLOWER]: Refusing update from remote peer 922e5dad8ed14b91af83f22b748816f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260619 04:39:59.266122 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.265770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33178)
0619 04:39:59.265920 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.265990 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260619 04:39:59.265991 17586 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260619 04:39:59.266376 16833 consensus_peers.cc:487] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 -> Peer 1109aa8588fb4702833e5d1cb37c5a84 (127.9.224.126:36341): Couldn't send request to peer 1109aa8588fb4702833e5d1cb37c5a84. Status: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 04:39:59.268882 17577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 922e5dad8ed14b91af83f22b748816f2. Latest consensus state: current_term: 2 leader_uuid: "922e5dad8ed14b91af83f22b748816f2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:59.269166 17577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:39:59.270658 17576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "922e5dad8ed14b91af83f22b748816f2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:59.270973 17576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2 [sys.catalog]: This master's current role is: LEADER
I20260619 04:39:59.271130 17577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "922e5dad8ed14b91af83f22b748816f2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1109aa8588fb4702833e5d1cb37c5a84" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36341 } } peers { permanent_uuid: "922e5dad8ed14b91af83f22b748816f2" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 44335 } attrs { promote: false } } peers { permanent_uuid: "0f56af58a57147c486ecf66d50bd287b" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33397 } attrs { promote: false } } }
I20260619 04:39:59.271412 17577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f56af58a57147c486ecf66d50bd287b [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:39:59.271283 17590 mvcc.cc:205] Tried to move back new op lower bound from 7298433020983533568 to 7298433020840587264. Current Snapshot: MvccSnapshot[applied={T|T < 7298433020983533568}]
I20260619 04:39:59.290177 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.279669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40411 (local address 127.0.0.1:39692)
0619 04:39:59.280006 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.280023 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:59.280125 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:59.281012 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:59.281020 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:59.281056 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:59.281475 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.281489 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.283521 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.283530 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.286491 (+ 2961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.286516 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.288979 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.288991 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.289283 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.289352 (+ 69us) client_negotiation.cc:769] Sending connection context
0619 04:39:59.289449 (+ 97us) client_negotiation.cc:240] Negotiation successful
0619 04:39:59.289671 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260619 04:39:59.291715 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.279997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39692 (local address 127.9.224.66:40411)
0619 04:39:59.280598 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.280607 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.280631 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:39:59.280719 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.280724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.280817 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.281644 (+ 827us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:59.281855 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.283299 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.286853 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.288660 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.290939 (+ 2279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.291096 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.291164 (+ 68us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.291376 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":293,"threads_started":1}
I20260619 04:39:59.292727 17298 tablet_service.cc:1467] Processing CreateTablet for tablet aa62f22e2d3a4376aedb1c01f99a5569 (DEFAULT_TABLE table=test-table [id=0efaa801d90b4d75a9bcd085e3fcfc22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:59.293357 17298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa62f22e2d3a4376aedb1c01f99a5569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:59.296800 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.279252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:38257 (local address 127.0.0.1:53138)
0619 04:39:59.279522 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.279544 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:59.279668 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:59.292116 (+ 12448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:59.292121 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:59.292145 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:59.292317 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.292330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.293295 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.293302 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.294665 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.294677 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.296011 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.296017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.296203 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.296227 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 04:39:59.296337 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 04:39:59.296499 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260619 04:39:59.296792 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.279336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.9.224.65:38257)
0619 04:39:59.291778 (+ 12442us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.291784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.291806 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:39:59.291878 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.291883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.291970 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.292100 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:59.292443 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.293158 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.294825 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.295836 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.295980 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.296084 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.296364 (+ 280us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.296502 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12297,"thread_start_us":12874,"threads_started":1}
I20260619 04:39:59.297530 17151 tablet_service.cc:1467] Processing CreateTablet for tablet aa62f22e2d3a4376aedb1c01f99a5569 (DEFAULT_TABLE table=test-table [id=0efaa801d90b4d75a9bcd085e3fcfc22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:59.297861 17151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa62f22e2d3a4376aedb1c01f99a5569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:59.300348 17598 tablet_bootstrap.cc:492] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Bootstrap starting.
I20260619 04:39:59.301277 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.280638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:34829 (local address 127.0.0.1:40898)
0619 04:39:59.290556 (+ 9918us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.290582 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:39:59.290713 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:39:59.294657 (+ 3944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:39:59.294662 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:39:59.294687 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:39:59.294862 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.294872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.296423 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.296428 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.298259 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:39:59.298275 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.300504 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.300510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:39:59.300698 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.300739 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 04:39:59.300800 (+ 61us) client_negotiation.cc:240] Negotiation successful
0619 04:39:59.300945 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9750,"thread_start_us":20225,"threads_started":1}
I20260619 04:39:59.302083 17598 tablet_bootstrap.cc:654] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:59.302109 17597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.280759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40898 (local address 127.9.224.67:34829)
0619 04:39:59.294101 (+ 13342us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.294107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.294356 (+ 249us) server_negotiation.cc:407] Connection header received
0619 04:39:59.294426 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.294431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.294508 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.295015 (+ 507us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:39:59.295204 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.296246 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.298822 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.300054 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.301506 (+ 1452us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.301619 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.301675 (+ 56us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.301811 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13208,"thread_start_us":13461,"threads_started":1}
I20260619 04:39:59.302912 17439 tablet_service.cc:1467] Processing CreateTablet for tablet aa62f22e2d3a4376aedb1c01f99a5569 (DEFAULT_TABLE table=test-table [id=0efaa801d90b4d75a9bcd085e3fcfc22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:39:59.303393 17439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa62f22e2d3a4376aedb1c01f99a5569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:39:59.305114 17598 tablet_bootstrap.cc:492] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: No bootstrap required, opened a new log
I20260619 04:39:59.305261 17598 ts_tablet_manager.cc:1397] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260619 04:39:59.306042 17598 raft_consensus.cc:348] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.306318 17598 raft_consensus.cc:374] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:59.306404 17598 raft_consensus.cc:729] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307fcf7f5fad46ba80a2999aef1b9393, State: Initialized, Role: FOLLOWER
I20260619 04:39:59.306476 17600 tablet_bootstrap.cc:492] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Bootstrap starting.
I20260619 04:39:59.306655 17598 consensus_queue.cc:260] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.307471 17598 ts_tablet_manager.cc:1428] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 04:39:59.308209 17600 tablet_bootstrap.cc:654] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:59.308993 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.308032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:60783)
0619 04:39:59.308571 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.308742 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"threads_started":1}
I20260619 04:39:59.311770 17365 heartbeater.cc:503] Master 127.9.224.125:44335 was elected leader, sending a full tablet report...
I20260619 04:39:59.314086 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.311636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:35315)
0619 04:39:59.313827 (+ 2191us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.313930 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2058}
I20260619 04:39:59.314193 17604 tablet_bootstrap.cc:492] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Bootstrap starting.
I20260619 04:39:59.316006 17604 tablet_bootstrap.cc:654] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Neither blocks nor log segments found. Creating new log.
I20260619 04:39:59.316395 17600 tablet_bootstrap.cc:492] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: No bootstrap required, opened a new log
I20260619 04:39:59.316551 17600 ts_tablet_manager.cc:1397] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260619 04:39:59.317200 17600 raft_consensus.cc:348] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.317430 17600 raft_consensus.cc:374] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:59.317524 17600 raft_consensus.cc:729] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f39354b4bd4cc58e739ba871d6b62c, State: Initialized, Role: FOLLOWER
I20260619 04:39:59.317812 17600 consensus_queue.cc:260] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.318666 17600 ts_tablet_manager.cc:1428] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260619 04:39:59.319857 17604 tablet_bootstrap.cc:492] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: No bootstrap required, opened a new log
I20260619 04:39:59.319877 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.318915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:58369)
0619 04:39:59.319461 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.319618 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":274,"threads_started":1}
I20260619 04:39:59.320031 17604 ts_tablet_manager.cc:1397] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260619 04:39:59.320571 17218 heartbeater.cc:503] Master 127.9.224.125:44335 was elected leader, sending a full tablet report...
I20260619 04:39:59.321158 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.320687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:41841)
0619 04:39:59.320946 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.321029 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260619 04:39:59.321338 17604 raft_consensus.cc:348] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.321581 17604 raft_consensus.cc:374] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:39:59.321695 17604 raft_consensus.cc:729] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa16815172824caaa0c6dbb8ce9b7c4f, State: Initialized, Role: FOLLOWER
I20260619 04:39:59.321923 17604 consensus_queue.cc:260] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.323308 17604 ts_tablet_manager.cc:1428] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 04:39:59.324263 17609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.323047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:60939)
0619 04:39:59.323833 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.323986 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":539,"threads_started":1}
I20260619 04:39:59.324813 17506 heartbeater.cc:503] Master 127.9.224.125:44335 was elected leader, sending a full tablet report...
I20260619 04:39:59.325744 17609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.324836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:57009)
0619 04:39:59.325512 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.325593 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":433,"threads_started":1}
W20260619 04:39:59.431620 17507 tablet.cc:2369] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:59.460541 17608 raft_consensus.cc:482] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:39:59.460783 17608 raft_consensus.cc:504] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.461562 17608 leader_election.cc:288] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257), 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:59.462200 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62f22e2d3a4376aedb1c01f99a5569" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307fcf7f5fad46ba80a2999aef1b9393" is_pre_election: true
I20260619 04:39:59.462175 17171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62f22e2d3a4376aedb1c01f99a5569" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f39354b4bd4cc58e739ba871d6b62c" is_pre_election: true
I20260619 04:39:59.462505 17318 raft_consensus.cc:2454] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 0.
I20260619 04:39:59.462504 17171 raft_consensus.cc:2454] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 0.
I20260619 04:39:59.462971 17395 leader_election.cc:302] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 307fcf7f5fad46ba80a2999aef1b9393, fa16815172824caaa0c6dbb8ce9b7c4f; no voters:
I20260619 04:39:59.463241 17608 raft_consensus.cc:2781] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:39:59.463342 17608 raft_consensus.cc:482] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:39:59.463400 17608 raft_consensus.cc:3037] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:59.465425 17608 raft_consensus.cc:504] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.465952 17608 leader_election.cc:288] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 election: Requested vote from peers 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257), 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411)
I20260619 04:39:59.466545 17171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62f22e2d3a4376aedb1c01f99a5569" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f39354b4bd4cc58e739ba871d6b62c"
I20260619 04:39:59.466615 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62f22e2d3a4376aedb1c01f99a5569" candidate_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "307fcf7f5fad46ba80a2999aef1b9393"
I20260619 04:39:59.466814 17171 raft_consensus.cc:3037] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:59.466835 17318 raft_consensus.cc:3037] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:39:59.470103 17318 raft_consensus.cc:2454] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 1.
I20260619 04:39:59.470103 17171 raft_consensus.cc:2454] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa16815172824caaa0c6dbb8ce9b7c4f in term 1.
I20260619 04:39:59.470631 17394 leader_election.cc:302] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 307fcf7f5fad46ba80a2999aef1b9393, 76f39354b4bd4cc58e739ba871d6b62c, fa16815172824caaa0c6dbb8ce9b7c4f; no voters:
I20260619 04:39:59.471062 17608 raft_consensus.cc:2781] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:39:59.471504 17608 raft_consensus.cc:686] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 LEADER]: Becoming Leader. State: Replica: fa16815172824caaa0c6dbb8ce9b7c4f, State: Running, Role: LEADER
I20260619 04:39:59.471880 17608 consensus_queue.cc:237] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } }
I20260619 04:39:59.473121 17610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.472283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:49305)
0619 04:39:59.472510 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.472750 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260619 04:39:59.475251 16846 catalog_manager.cc:5495] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f reported cstate change: term changed from 0 to 1, leader changed from <none> to fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67). New cstate: current_term: 1 leader_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa16815172824caaa0c6dbb8ce9b7c4f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 34829 } health_report { overall_health: HEALTHY } } }
I20260619 04:39:59.497992 17597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.493096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.9.224.67:34829)
0619 04:39:59.493256 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.493260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.493344 (+ 84us) server_negotiation.cc:407] Connection header received
0619 04:39:59.493534 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.493538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.493606 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.493685 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:39:59.494128 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.495015 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.496438 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.496861 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.496973 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.497399 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:39:59.497503 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:39:59.497571 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.497721 (+ 150us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.497785 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 04:39:59.501586 17318 raft_consensus.cc:1261] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Refusing update from remote peer fa16815172824caaa0c6dbb8ce9b7c4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:59.501641 17171 raft_consensus.cc:1261] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Refusing update from remote peer fa16815172824caaa0c6dbb8ce9b7c4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:39:59.502367 17611 consensus_queue.cc:1035] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "307fcf7f5fad46ba80a2999aef1b9393" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:59.502689 17608 consensus_queue.cc:1035] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f39354b4bd4cc58e739ba871d6b62c" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:39:59.505335 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.504821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:43251)
0619 04:39:59.505004 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.505116 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260619 04:39:59.505774 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.505041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:41165)
0619 04:39:59.505365 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.505503 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260619 04:39:59.512956 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.512537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.65:33073)
0619 04:39:59.512692 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.512790 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260619 04:39:59.514923 17610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.514432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:40603)
0619 04:39:59.514648 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.514745 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260619 04:39:59.519021 17615 mvcc.cc:205] Tried to move back new op lower bound from 7298433021951750144 to 7298433021839458304. Current Snapshot: MvccSnapshot[applied={T|T < 7298433021951750144 or (T in {7298433021951750144})}]
I20260619 04:39:59.519565 16845 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:59.519779 16845 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:39:59.527352 16845 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 922e5dad8ed14b91af83f22b748816f2: Sending DeleteTablet for 3 replicas of tablet aa62f22e2d3a4376aedb1c01f99a5569
I20260619 04:39:59.528532 17298 tablet_service.cc:1514] Processing DeleteTablet for tablet aa62f22e2d3a4376aedb1c01f99a5569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:59 UTC) from {username='oryx', principal='oryx/127.9.224.125@KRBTEST.COM'} at 127.0.0.1:39692
W20260619 04:39:59.528687 17374 tablet.cc:2369] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:39:59.528676 17439 tablet_service.cc:1514] Processing DeleteTablet for tablet aa62f22e2d3a4376aedb1c01f99a5569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:59 UTC) from {username='oryx', principal='oryx/127.9.224.125@KRBTEST.COM'} at 127.0.0.1:40898
I20260619 04:39:59.529537 17151 tablet_service.cc:1514] Processing DeleteTablet for tablet aa62f22e2d3a4376aedb1c01f99a5569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:39:59 UTC) from {username='oryx', principal='oryx/127.9.224.125@KRBTEST.COM'} at 127.0.0.1:53138
I20260619 04:39:59.531873 17610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.531122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.67:40997)
0619 04:39:59.531454 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.531584 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260619 04:39:59.532212 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 17024
I20260619 04:39:59.534806 17624 tablet_replica.cc:330] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: stopping tablet replica
I20260619 04:39:59.535077 17624 raft_consensus.cc:2229] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:39:59.535619 17624 raft_consensus.cc:2258] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:59.536939 17624 ts_tablet_manager.cc:1905] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:59.543269 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.542566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.9.224.66:44969)
0619 04:39:59.542901 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.543028 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260619 04:39:59.546655 17624 ts_tablet_manager.cc:1918] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:59.546876 17624 log.cc:1196] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/aa62f22e2d3a4376aedb1c01f99a5569
I20260619 04:39:59.547420 17624 ts_tablet_manager.cc:1939] T aa62f22e2d3a4376aedb1c01f99a5569 P fa16815172824caaa0c6dbb8ce9b7c4f: Deleting consensus metadata
I20260619 04:39:59.547639 17625 tablet_replica.cc:330] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: stopping tablet replica
I20260619 04:39:59.547906 17625 raft_consensus.cc:2229] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:59.548300 17625 raft_consensus.cc:2258] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:59.549413 16830 catalog_manager.cc:4841] TS fa16815172824caaa0c6dbb8ce9b7c4f (127.9.224.67:34829): tablet aa62f22e2d3a4376aedb1c01f99a5569 (table test-table [id=0efaa801d90b4d75a9bcd085e3fcfc22]) successfully deleted
I20260619 04:39:59.549978 17625 ts_tablet_manager.cc:1905] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:59.550259 17623 tablet_replica.cc:330] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: stopping tablet replica
I20260619 04:39:59.550470 17623 raft_consensus.cc:2229] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:39:59.551431 17623 raft_consensus.cc:2258] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:39:59.553540 17623 ts_tablet_manager.cc:1905] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:39:59.555435 17625 ts_tablet_manager.cc:1918] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:59.555588 17625 log.cc:1196] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/aa62f22e2d3a4376aedb1c01f99a5569
I20260619 04:39:59.556030 17625 ts_tablet_manager.cc:1939] T aa62f22e2d3a4376aedb1c01f99a5569 P 76f39354b4bd4cc58e739ba871d6b62c: Deleting consensus metadata
I20260619 04:39:59.557150 16832 catalog_manager.cc:4841] TS 76f39354b4bd4cc58e739ba871d6b62c (127.9.224.65:38257): tablet aa62f22e2d3a4376aedb1c01f99a5569 (table test-table [id=0efaa801d90b4d75a9bcd085e3fcfc22]) successfully deleted
I20260619 04:39:59.559986 17623 ts_tablet_manager.cc:1918] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:39:59.560097 17623 log.cc:1196] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/aa62f22e2d3a4376aedb1c01f99a5569
I20260619 04:39:59.560513 17623 ts_tablet_manager.cc:1939] T aa62f22e2d3a4376aedb1c01f99a5569 P 307fcf7f5fad46ba80a2999aef1b9393: Deleting consensus metadata
I20260619 04:39:59.561682 16833 catalog_manager.cc:4841] TS 307fcf7f5fad46ba80a2999aef1b9393 (127.9.224.66:40411): tablet aa62f22e2d3a4376aedb1c01f99a5569 (table test-table [id=0efaa801d90b4d75a9bcd085e3fcfc22]) successfully deleted
I20260619 04:39:59.567020 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.533282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53148 (local address 127.9.224.65:38257)
0619 04:39:59.533636 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.533645 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.549541 (+ 15896us) server_negotiation.cc:407] Connection header received
0619 04:39:59.549874 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.549879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.549968 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.550076 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:59.554750 (+ 4674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.555466 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.557309 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.557954 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.558086 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.561061 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:59.561082 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:59.561103 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:59.561147 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:59.564214 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:59.564934 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:59.564942 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:59.564944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:59.565085 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:59.565489 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:59.565493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:59.565495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:59.565856 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:59.566165 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.566474 (+ 309us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.566715 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:39:59.567647 17211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:59.666963 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 17024
I20260619 04:39:59.683106 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.682664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33184)
0619 04:39:59.682844 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.682959 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260619 04:39:59.684211 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.683806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36341 (local address 127.0.0.1:33186)
0619 04:39:59.683983 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 04:39:59.684073 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260619 04:39:59.686019 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 17228
I20260619 04:39:59.700171 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.686856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39694 (local address 127.9.224.66:40411)
0619 04:39:59.687053 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.687058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.687079 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:39:59.687262 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.687266 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.687335 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.687428 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:59.688755 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.689430 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.690959 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.691351 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.691487 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.694004 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:59.694020 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:59.694036 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:59.694073 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:59.697357 (+ 3284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:59.698090 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:59.698097 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:59.698099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:59.698281 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:59.698675 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:59.698678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:59.698680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:59.699050 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:59.699266 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.699564 (+ 298us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.699826 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 04:39:59.700989 17358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:59.795575 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 17228
I20260619 04:39:59.815663 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 17376
I20260619 04:39:59.830024 17597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:39:59.816480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.9.224.67:34829)
0619 04:39:59.816659 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 04:39:59.816665 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:39:59.816736 (+ 71us) server_negotiation.cc:407] Connection header received
0619 04:39:59.816981 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:39:59.816989 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:39:59.817079 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:39:59.817215 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:39:59.818756 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.819478 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.820725 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:39:59.821112 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:39:59.821259 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:39:59.824051 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:39:59.824067 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:39:59.824083 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:39:59.824118 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:39:59.827229 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:59.827985 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:59.827995 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:59.828001 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:59.828137 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:39:59.828529 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:39:59.828536 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:39:59.828539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:39:59.828890 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:39:59.829188 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0619 04:39:59.829485 (+ 297us) server_negotiation.cc:299] Negotiation successful
0619 04:39:59.829704 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 04:39:59.830747 17499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:39:59.952132 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 17376
I20260619 04:39:59.976084 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16707
I20260619 04:39:59.977421 16876 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:00.102669 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16707
I20260619 04:40:00.123829 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 16807
I20260619 04:40:00.124850 17067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:00.239451 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 16807
2026-06-19T04:40:00Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9795 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:40:00 dist-test-slave-9dgf krb5kdc[17635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:40:00 dist-test-slave-9dgf krb5kdc[17635](info): set up 2 sockets
Jun 19 04:40:00 dist-test-slave-9dgf krb5kdc[17635](info): commencing operation
krb5kdc: starting...
W20260619 04:40:01.367607 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:40:01 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:40:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:01Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab.
Entry for principal oryx/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab.
I20260619 04:40:01.607368 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36933
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab
--principal=oryx/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:01.955478 17648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:01.955839 17648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:01.956004 17648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:01.963369 17648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:01.963513 17648 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 04:40:01.963601 17648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:01.963696 17648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:01.963805 17648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:01.963893 17648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:01.973881 17648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36933
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.126.keytab
--principal=oryx/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:01.975296 17648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:01.976675 17648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:01.989091 17653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:01.989007 17656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:01.989040 17654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:01.989888 17648 server_base.cc:1034] running on GCE node
I20260619 04:40:01.990777 17648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:01.992300 17648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:01.993600 17648 hybrid_clock.cc:648] HybridClock initialized: now 1781844001993492 us; error 63 us; skew 500 ppm
I20260619 04:40:01.993989 17648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:01 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844001, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:01.997640 17648 init.cc:377] Logged in from keytab as oryx/127.9.224.126@KRBTEST.COM (short username oryx)
I20260619 04:40:01.999363 17648 webserver.cc:460] Webserver started at http://127.9.224.126:33909/ using document root <none> and password file <none>
I20260619 04:40:02.000150 17648 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:02.000288 17648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:02.000640 17648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:02.004065 17648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "cfe51b5527a94c4781bf8f4b351901b5"
format_stamp: "Formatted at 2026-06-19 04:40:01 on dist-test-slave-9dgf"
server_key: "90678357767ecce44f66238fe96196cb"
server_key_iv: "9e734f6630fc3a9c8e6663114ec35820"
server_key_version: "encryptionkey@0"
I20260619 04:40:02.005030 17648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "cfe51b5527a94c4781bf8f4b351901b5"
format_stamp: "Formatted at 2026-06-19 04:40:01 on dist-test-slave-9dgf"
server_key: "90678357767ecce44f66238fe96196cb"
server_key_iv: "9e734f6630fc3a9c8e6663114ec35820"
server_key_version: "encryptionkey@0"
I20260619 04:40:02.011652 17648 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260619 04:40:02.015890 17663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:02.017457 17648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:40:02.017673 17648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "cfe51b5527a94c4781bf8f4b351901b5"
format_stamp: "Formatted at 2026-06-19 04:40:01 on dist-test-slave-9dgf"
server_key: "90678357767ecce44f66238fe96196cb"
server_key_iv: "9e734f6630fc3a9c8e6663114ec35820"
server_key_version: "encryptionkey@0"
I20260619 04:40:02.017952 17648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:02.046811 17648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:02.051992 17648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:02.052340 17648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:02.078071 17648 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36933
I20260619 04:40:02.078091 17724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36933 every 8 connection(s)
I20260619 04:40:02.080030 17648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:40:02.081064 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 17648
I20260619 04:40:02.081326 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:40:02.082329 10113 external_mini_cluster.cc:1428] Setting key ba4da97d5c54e6ce654c09a5c34bbce1
I20260619 04:40:02.086660 17725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:02.099186 17725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Bootstrap starting.
Jun 19 04:40:02 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:02.103515 17725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:02.104724 17725 log.cc:824] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:02.108666 17725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: No bootstrap required, opened a new log
I20260619 04:40:02.109808 17728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:02.084852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44174 (local address 127.9.224.126:36933)
0619 04:40:02.087400 (+ 2548us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:02.087415 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:02.087476 (+ 61us) server_negotiation.cc:407] Connection header received
0619 04:40:02.089235 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:02.089260 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:02.089719 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:02.090261 (+ 542us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:02.092242 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.093651 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.095164 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.095942 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.096200 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:02.100684 (+ 4484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:02.100694 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:02.100711 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:02.100755 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:02.104692 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:02.105773 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:02.105786 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:02.105799 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:02.106035 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:02.106540 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:02.106544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:02.106546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:02.107300 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:02.107597 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:02.108151 (+ 554us) server_negotiation.cc:299] Negotiation successful
0619 04:40:02.108659 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2289,"thread_start_us":1991,"threads_started":1}
I20260619 04:40:02.117941 17725 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe51b5527a94c4781bf8f4b351901b5" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36933 } }
I20260619 04:40:02.118515 17725 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:02.118630 17725 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe51b5527a94c4781bf8f4b351901b5, State: Initialized, Role: FOLLOWER
I20260619 04:40:02.119252 17725 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe51b5527a94c4781bf8f4b351901b5" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36933 } }
I20260619 04:40:02.119496 17725 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:40:02.119652 17725 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:40:02.119844 17725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:02.122030 17725 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe51b5527a94c4781bf8f4b351901b5" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36933 } }
I20260619 04:40:02.122648 17725 leader_election.cc:302] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfe51b5527a94c4781bf8f4b351901b5; no voters:
I20260619 04:40:02.123441 17725 leader_election.cc:288] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:40:02.123551 17730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:02.124208 17730 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [term 1 LEADER]: Becoming Leader. State: Replica: cfe51b5527a94c4781bf8f4b351901b5, State: Running, Role: LEADER
I20260619 04:40:02.124886 17730 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe51b5527a94c4781bf8f4b351901b5" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36933 } }
I20260619 04:40:02.125976 17725 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:40:02.128249 17732 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfe51b5527a94c4781bf8f4b351901b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe51b5527a94c4781bf8f4b351901b5" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36933 } } }
I20260619 04:40:02.128790 17731 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfe51b5527a94c4781bf8f4b351901b5. Latest consensus state: current_term: 1 leader_uuid: "cfe51b5527a94c4781bf8f4b351901b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe51b5527a94c4781bf8f4b351901b5" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36933 } } }
I20260619 04:40:02.129242 17732 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:02.129748 17731 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:02.134861 17738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:40:02.140909 17738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:40:02.150636 17738 catalog_manager.cc:1347] Generated new cluster ID: a37b3b10778a4c12b8374b08684f7c67
I20260619 04:40:02.150779 17738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:40:02.166373 17738 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:40:02.168421 17738 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:40:02.178251 17738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Generated new TSK 0
I20260619 04:40:02.179337 17738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab.
Entry for principal oryx/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab.
I20260619 04:40:02.238489 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36933
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:02.581382 17751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:02.581702 17751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:02.581807 17751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:02.589285 17751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:02.589411 17751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:02.589502 17751 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:40:02.589593 17751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:40:02.599611 17751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:36933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:02.600952 17751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:02.602533 17751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:02.617019 17756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:02.617089 17757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:02.617127 17759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:02.617944 17751 server_base.cc:1034] running on GCE node
I20260619 04:40:02.618781 17751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:02.619766 17751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:02.621047 17751 hybrid_clock.cc:648] HybridClock initialized: now 1781844002620965 us; error 43 us; skew 500 ppm
I20260619 04:40:02.621503 17751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:02 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844002, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:02.625226 17751 init.cc:377] Logged in from keytab as oryx/127.9.224.65@KRBTEST.COM (short username oryx)
I20260619 04:40:02.627127 17751 webserver.cc:460] Webserver started at http://127.9.224.65:34683/ using document root <none> and password file <none>
I20260619 04:40:02.627930 17751 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:02.628088 17751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:02.628481 17751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:02.631811 17751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "40559a4153bc4ce5bff11deaf49e7b5b"
format_stamp: "Formatted at 2026-06-19 04:40:02 on dist-test-slave-9dgf"
server_key: "7f080e1d371e9db0d3270725aac9bd85"
server_key_iv: "6abd0f71d35d8b9475c02208a194b928"
server_key_version: "encryptionkey@0"
I20260619 04:40:02.632695 17751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "40559a4153bc4ce5bff11deaf49e7b5b"
format_stamp: "Formatted at 2026-06-19 04:40:02 on dist-test-slave-9dgf"
server_key: "7f080e1d371e9db0d3270725aac9bd85"
server_key_iv: "6abd0f71d35d8b9475c02208a194b928"
server_key_version: "encryptionkey@0"
I20260619 04:40:02.638844 17751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260619 04:40:02.642930 17766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:02.644585 17751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260619 04:40:02.644788 17751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "40559a4153bc4ce5bff11deaf49e7b5b"
format_stamp: "Formatted at 2026-06-19 04:40:02 on dist-test-slave-9dgf"
server_key: "7f080e1d371e9db0d3270725aac9bd85"
server_key_iv: "6abd0f71d35d8b9475c02208a194b928"
server_key_version: "encryptionkey@0"
I20260619 04:40:02.645030 17751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:02.669982 17751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:02.674825 17751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:02.675159 17751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:02.678109 17751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:02.678243 17751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:02.678426 17751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:02.678505 17751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:40:02 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844002, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:02.705258 17775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:02.678862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:46197 (local address 127.9.224.126:36933)
0619 04:40:02.681889 (+ 3027us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:02.681894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:02.681913 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:40:02.684542 (+ 2629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:02.684550 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:02.684637 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:02.684731 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:02.687619 (+ 2888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.688583 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.691922 (+ 3339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.692340 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.692451 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:02.697542 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:02.697548 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:02.697551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:02.697589 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:02.700729 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:02.701853 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:02.701859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:02.701862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:02.702052 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:02.702761 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:02.702766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:02.702771 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:02.703063 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:02.703232 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:02.704440 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0619 04:40:02.704749 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2903,"thread_start_us":2819,"threads_started":1}
I20260619 04:40:02.707259 17776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:02.679816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.9.224.65:46197)
0619 04:40:02.680916 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:02.680981 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:02.684096 (+ 3115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:02.685083 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:02.685098 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:02.686164 (+ 1066us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:02.687364 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:02.687393 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.688778 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.688791 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:02.691720 (+ 2929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:02.691743 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.692629 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.692638 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:02.693008 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:02.693915 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:02.693957 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:02.697269 (+ 3312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:02.700961 (+ 3692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:02.700974 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:02.701004 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:02.701695 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:02.702218 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:02.702256 (+ 38us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:02.702260 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:02.702619 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:02.703205 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:02.703213 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:02.703806 (+ 593us) client_negotiation.cc:769] Sending connection context
0619 04:40:02.704262 (+ 456us) client_negotiation.cc:240] Negotiation successful
0619 04:40:02.705091 (+ 829us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":451,"threads_started":1}
I20260619 04:40:02.725862 17751 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:39909
I20260619 04:40:02.726011 17886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:39909 every 8 connection(s)
I20260619 04:40:02.727715 17751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:40:02.730969 17887 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36933
I20260619 04:40:02.731294 17887 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:02.732184 17887 heartbeater.cc:511] Master 127.9.224.126:36933 requested a full tablet report, sending...
I20260619 04:40:02.734074 17775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:02.716094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:47881 (local address 127.9.224.126:36933)
0619 04:40:02.716579 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:02.716585 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:02.717520 (+ 935us) server_negotiation.cc:407] Connection header received
0619 04:40:02.717786 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:02.717795 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:02.717897 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:02.718022 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:02.720089 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.721020 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.723848 (+ 2828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.724625 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.724800 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:02.727636 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:02.727642 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:02.727645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:02.727683 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:02.731009 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:02.731857 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:02.731863 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:02.731866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:02.732035 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:02.732498 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:02.732505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:02.732508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:02.732857 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:02.733026 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:02.733501 (+ 475us) server_negotiation.cc:299] Negotiation successful
0619 04:40:02.733778 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247}
I20260619 04:40:02.734079 17864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:02.716168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.9.224.65:47881)
0619 04:40:02.717344 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:02.717373 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:02.717599 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:02.718284 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:02.718293 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:02.719211 (+ 918us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:02.719787 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:02.719809 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.721228 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.721235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:02.723609 (+ 2374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:02.723630 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:02.724895 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:02.724905 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:02.725163 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:02.726028 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:02.726055 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:02.727217 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:02.731171 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:02.731177 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:02.731184 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:02.731710 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:02.732148 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:02.732151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:02.732154 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:02.732372 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:02.732970 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:02.732973 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:02.733175 (+ 202us) client_negotiation.cc:769] Sending connection context
0619 04:40:02.733331 (+ 156us) client_negotiation.cc:240] Negotiation successful
0619 04:40:02.733607 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"thread_start_us":831,"threads_started":1}
I20260619 04:40:02.735031 17680 ts_manager.cc:194] Registered new tserver with Master: 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909)
I20260619 04:40:02.735208 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 17751
I20260619 04:40:02.735406 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:40:02.736491 10113 external_mini_cluster.cc:1428] Setting key 552224371d34b79af90d2d0f80e397af
I20260619 04:40:02.743830 17680 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:46197
WARNING: no policy specified for oryx/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab.
Entry for principal oryx/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab.
I20260619 04:40:02.799542 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36933
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:03.158746 17891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:03.159087 17891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:03.159197 17891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:03.167811 17891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:03.167953 17891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:03.168056 17891 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:40:03.168146 17891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:40:03.179572 17891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:36933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:03.180935 17891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:03.182505 17891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:03.197669 17897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:03.197749 17896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:03.197628 17899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:03.198927 17891 server_base.cc:1034] running on GCE node
I20260619 04:40:03.199606 17891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:03.200642 17891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:03.201887 17891 hybrid_clock.cc:648] HybridClock initialized: now 1781844003201785 us; error 75 us; skew 500 ppm
I20260619 04:40:03.202308 17891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844003, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:03.206035 17891 init.cc:377] Logged in from keytab as oryx/127.9.224.66@KRBTEST.COM (short username oryx)
I20260619 04:40:03.207901 17891 webserver.cc:460] Webserver started at http://127.9.224.66:34707/ using document root <none> and password file <none>
I20260619 04:40:03.208869 17891 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:03.209017 17891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:03.209380 17891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:03.212708 17891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "d20bf2ac02f0474986a144fb399c59cf"
format_stamp: "Formatted at 2026-06-19 04:40:03 on dist-test-slave-9dgf"
server_key: "ea25145458c536bf2d572546b9c3bcd3"
server_key_iv: "5d4835be90f266fd2f7d23a7087f0eb4"
server_key_version: "encryptionkey@0"
I20260619 04:40:03.213567 17891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "d20bf2ac02f0474986a144fb399c59cf"
format_stamp: "Formatted at 2026-06-19 04:40:03 on dist-test-slave-9dgf"
server_key: "ea25145458c536bf2d572546b9c3bcd3"
server_key_iv: "5d4835be90f266fd2f7d23a7087f0eb4"
server_key_version: "encryptionkey@0"
I20260619 04:40:03.219059 17891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:40:03.222754 17906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:03.224220 17891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:40:03.224408 17891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "d20bf2ac02f0474986a144fb399c59cf"
format_stamp: "Formatted at 2026-06-19 04:40:03 on dist-test-slave-9dgf"
server_key: "ea25145458c536bf2d572546b9c3bcd3"
server_key_iv: "5d4835be90f266fd2f7d23a7087f0eb4"
server_key_version: "encryptionkey@0"
I20260619 04:40:03.224666 17891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:03.247525 17891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:03.252225 17891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:03.252521 17891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:03.255513 17891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:03.255637 17891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:03.255823 17891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:03.255908 17891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844003, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:03.282316 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.256048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:58915 (local address 127.9.224.126:36933)
0619 04:40:03.256852 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:03.256859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:03.258030 (+ 1171us) server_negotiation.cc:407] Connection header received
0619 04:40:03.260218 (+ 2188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:03.260224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:03.260322 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:03.260438 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:03.262863 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.264048 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.266909 (+ 2861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.267663 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.267814 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.273622 (+ 5808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:03.273632 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:03.273637 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:03.273689 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:03.277959 (+ 4270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.279193 (+ 1234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.279206 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.279209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.279416 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.280151 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.280155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.280157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.280434 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:03.280568 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:03.281773 (+ 1205us) server_negotiation.cc:299] Negotiation successful
0619 04:40:03.281967 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":554,"threads_started":1}
I20260619 04:40:03.284790 17916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.256869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.9.224.66:58915)
0619 04:40:03.257824 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:03.257878 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:03.259907 (+ 2029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:03.260743 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:03.260762 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:03.261645 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:03.262637 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.262674 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.264278 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.264285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.266729 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.266743 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.267936 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.267944 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.268294 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.269182 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:03.269242 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:03.273240 (+ 3998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:03.278205 (+ 4965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.278219 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.278270 (+ 51us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.279027 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.279580 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.279590 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.279596 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.279994 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.280582 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:03.280596 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:03.281263 (+ 667us) client_negotiation.cc:769] Sending connection context
0619 04:40:03.281693 (+ 430us) client_negotiation.cc:240] Negotiation successful
0619 04:40:03.282495 (+ 802us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":412,"threads_started":1}
I20260619 04:40:03.307371 17996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.291604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.9.224.66:48741)
0619 04:40:03.292236 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:03.292256 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:03.292437 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:03.292798 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:03.292802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:03.293308 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:03.293617 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.293626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.294858 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.294867 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.297011 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.297031 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.297866 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.297875 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.298084 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.298814 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:03.298840 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:03.299899 (+ 1059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:03.304281 (+ 4382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.304289 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.304294 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.304855 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.305388 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.305393 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.305401 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.305626 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.306456 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:03.306467 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:03.306638 (+ 171us) client_negotiation.cc:769] Sending connection context
0619 04:40:03.306759 (+ 121us) client_negotiation.cc:240] Negotiation successful
0619 04:40:03.307043 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":344,"threads_started":1}
I20260619 04:40:03.307490 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.291547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:48741 (local address 127.9.224.126:36933)
0619 04:40:03.291732 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:03.291736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:03.292359 (+ 623us) server_negotiation.cc:407] Connection header received
0619 04:40:03.292580 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:03.292586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:03.292668 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:03.292771 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:03.293768 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.294669 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.297192 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.297597 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.297750 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.300141 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:03.300147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:03.300150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:03.300184 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:03.304107 (+ 3923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.305019 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.305028 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.305035 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.305198 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.305766 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.305774 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.305779 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.306193 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:03.306381 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:03.306909 (+ 528us) server_negotiation.cc:299] Negotiation successful
0619 04:40:03.307138 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:40:03.308936 17891 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:36593
I20260619 04:40:03.308976 18026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:36593 every 8 connection(s)
I20260619 04:40:03.310441 17891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:40:03.312964 18027 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36933
I20260619 04:40:03.313160 18027 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:03.313742 18027 heartbeater.cc:511] Master 127.9.224.126:36933 requested a full tablet report, sending...
I20260619 04:40:03.315083 17680 ts_manager.cc:194] Registered new tserver with Master: d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593)
I20260619 04:40:03.315843 17680 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:58915
I20260619 04:40:03.318625 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 17891
I20260619 04:40:03.318754 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:40:03.319142 10113 external_mini_cluster.cc:1428] Setting key c00f3e7e72ef1c95077d0f6c93e996f9
WARNING: no policy specified for oryx/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab.
Entry for principal oryx/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab.
I20260619 04:40:03.370802 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36933
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:03.713531 18031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:03.713862 18031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:03.713987 18031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:03.721494 18031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:03.721688 18031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:03.721856 18031 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 04:40:03.722015 18031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:40:03.733172 18031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.224.126:36933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:03.734653 18031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:03.736181 18031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 04:40:03.748330 17887 heartbeater.cc:503] Master 127.9.224.126:36933 was elected leader, sending a full tablet report...
W20260619 04:40:03.750119 18037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:03.750658 18036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:03.751840 18039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:03.752332 18031 server_base.cc:1034] running on GCE node
I20260619 04:40:03.753048 18031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:03.754204 18031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:03.755510 18031 hybrid_clock.cc:648] HybridClock initialized: now 1781844003755441 us; error 46 us; skew 500 ppm
I20260619 04:40:03.755892 18031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844003, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:03.759282 18031 init.cc:377] Logged in from keytab as oryx/127.9.224.67@KRBTEST.COM (short username oryx)
I20260619 04:40:03.760890 18031 webserver.cc:460] Webserver started at http://127.9.224.67:37371/ using document root <none> and password file <none>
I20260619 04:40:03.761686 18031 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:03.761832 18031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:03.762182 18031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:03.765376 18031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "8cea298284014e2cab6c6bacdf860176"
format_stamp: "Formatted at 2026-06-19 04:40:03 on dist-test-slave-9dgf"
server_key: "70474f4ea76042ab7ad214283eef91fe"
server_key_iv: "61853a91bcbd6a0ccab627851a653e72"
server_key_version: "encryptionkey@0"
I20260619 04:40:03.766350 18031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "8cea298284014e2cab6c6bacdf860176"
format_stamp: "Formatted at 2026-06-19 04:40:03 on dist-test-slave-9dgf"
server_key: "70474f4ea76042ab7ad214283eef91fe"
server_key_iv: "61853a91bcbd6a0ccab627851a653e72"
server_key_version: "encryptionkey@0"
I20260619 04:40:03.772063 18031 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:40:03.776290 18046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:03.777810 18031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:40:03.778002 18031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "8cea298284014e2cab6c6bacdf860176"
format_stamp: "Formatted at 2026-06-19 04:40:03 on dist-test-slave-9dgf"
server_key: "70474f4ea76042ab7ad214283eef91fe"
server_key_iv: "61853a91bcbd6a0ccab627851a653e72"
server_key_version: "encryptionkey@0"
I20260619 04:40:03.778276 18031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:03.803951 18031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:03.808845 18031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:03.809137 18031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:03.812091 18031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:03.812222 18031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:03.812570 18031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:03.812667 18031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844003, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:03.842921 18055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.813131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:48859 (local address 127.9.224.126:36933)
0619 04:40:03.813744 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:03.813749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:03.815139 (+ 1390us) server_negotiation.cc:407] Connection header received
0619 04:40:03.817734 (+ 2595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:03.817740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:03.817834 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:03.817967 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:03.820587 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.821934 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.824758 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.825417 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.825596 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.831971 (+ 6375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:03.831981 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:03.831988 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:03.832042 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:03.835395 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.839586 (+ 4191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.839595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.839602 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.839781 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.840522 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.840534 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.840537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.840845 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:03.840981 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:03.842397 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0619 04:40:03.842624 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":379,"threads_started":1}
I20260619 04:40:03.845332 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.813966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.9.224.67:48859)
0619 04:40:03.814951 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:03.815006 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:03.817312 (+ 2306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:03.818322 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:03.818338 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:03.819283 (+ 945us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:03.820271 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.820318 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.822085 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.822092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.824583 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.824597 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.825721 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.825731 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.826221 (+ 490us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.827350 (+ 1129us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:03.827391 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:03.831617 (+ 4226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:03.835617 (+ 4000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.835633 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.835661 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.839348 (+ 3687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.839916 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.839924 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.839931 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.840345 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.840999 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:03.841011 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:03.841754 (+ 743us) client_negotiation.cc:769] Sending connection context
0619 04:40:03.842219 (+ 465us) client_negotiation.cc:240] Negotiation successful
0619 04:40:03.843125 (+ 906us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":431,"threads_started":1}
I20260619 04:40:03.860829 18031 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33897
I20260619 04:40:03.860841 18166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33897 every 8 connection(s)
I20260619 04:40:03.862538 18031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:40:03.864595 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18031
I20260619 04:40:03.864769 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:40:03.865051 18167 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36933
I20260619 04:40:03.865231 18167 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:03.865329 10113 external_mini_cluster.cc:1428] Setting key 5a6d65648d4a688150f83e0214c5bbd4
I20260619 04:40:03.866046 18167 heartbeater.cc:511] Master 127.9.224.126:36933 requested a full tablet report, sending...
I20260619 04:40:03.867712 17680 ts_manager.cc:194] Registered new tserver with Master: 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:03.868866 17680 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:48859
I20260619 04:40:03.868964 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:40:03.871260 18055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.853801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:57281 (local address 127.9.224.126:36933)
0619 04:40:03.854009 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:03.854017 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:03.855272 (+ 1255us) server_negotiation.cc:407] Connection header received
0619 04:40:03.855624 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:03.855634 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:03.855750 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:03.855894 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:03.857794 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.858809 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.861151 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.861773 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.861911 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.864786 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:03.864794 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:03.864799 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:03.864843 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:03.868294 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.869181 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.869186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.869189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.869337 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:03.869777 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:03.869781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:03.869783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:03.870036 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:03.870194 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:03.870657 (+ 463us) server_negotiation.cc:299] Negotiation successful
0619 04:40:03.870886 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:40:03.871436 18150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:03.853910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.9.224.67:57281)
0619 04:40:03.855132 (+ 1222us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:03.855159 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:03.855429 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:03.855952 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:03.855961 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:03.856811 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:03.857601 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.857620 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.858988 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.858993 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.860968 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:03.860984 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.861963 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.861968 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:03.862107 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:03.862815 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:03.862838 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:03.864521 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:03.868434 (+ 3913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.868439 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.868443 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.868982 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.869451 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:03.869458 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:03.869465 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:03.869638 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:03.870158 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:03.870164 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:03.870409 (+ 245us) client_negotiation.cc:769] Sending connection context
0619 04:40:03.870556 (+ 147us) client_negotiation.cc:240] Negotiation successful
0619 04:40:03.870934 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"mutex_wait_us":30,"thread_start_us":554,"threads_started":1}
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844003, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:03 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:04.318219 18027 heartbeater.cc:503] Master 127.9.224.126:36933 was elected leader, sending a full tablet report...
I20260619 04:40:04.872419 18167 heartbeater.cc:503] Master 127.9.224.126:36933 was elected leader, sending a full tablet report...
W20260619 04:40:04.986225 18175 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.067s user 0.004s sys 0.011s
W20260619 04:40:04.987673 18055 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:03.912810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43134 (local address 127.9.224.126:36933)
0619 04:40:03.913017 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:03.913021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:03.913239 (+ 218us) server_negotiation.cc:407] Connection header received
0619 04:40:03.913382 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:03.913385 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:03.913466 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:03.913558 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:03.915047 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.915764 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.917211 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:03.917666 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:03.917774 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:04.987359 (+1069585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43134: BlockingRecv error: recv got EOF from 127.0.0.1:43134 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Jun 19 04:40:05 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844003, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:05.013155 18055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:04.992263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43140 (local address 127.9.224.126:36933)
0619 04:40:04.992429 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:04.992433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:04.992769 (+ 336us) server_negotiation.cc:407] Connection header received
0619 04:40:04.992984 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:04.992990 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:04.993097 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:04.993214 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:04.994960 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:04.995674 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:04.996998 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:04.997457 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:04.997591 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.007572 (+ 9981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:05.007579 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:05.007582 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:05.007629 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:05.010455 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:05.011323 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:05.011327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:05.011329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:05.011472 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:05.011901 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:05.011904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:05.011906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:05.012164 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:05.012354 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.012708 (+ 354us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.012906 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260619 04:40:05.017479 17680 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:40:05.025367 17680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:40:05.060725 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.038373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36593 (local address 127.0.0.1:42518)
0619 04:40:05.039132 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.039180 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.039345 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.053799 (+ 14454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.053806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.053836 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.054315 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.054333 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.056005 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.056011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.058163 (+ 2152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.058176 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.059615 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.059622 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.059885 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.059927 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.060082 (+ 155us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.060310 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":37,"thread_start_us":322,"threads_started":1}
I20260619 04:40:05.060961 18187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.038601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42518 (local address 127.9.224.66:36593)
0619 04:40:05.052963 (+ 14362us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.052974 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.053012 (+ 38us) server_negotiation.cc:407] Connection header received
0619 04:40:05.053149 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.053159 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.053488 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.053791 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.054516 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.055874 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.058361 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.059376 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.059547 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.059825 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.060187 (+ 362us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.060670 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14205,"thread_start_us":14072,"threads_started":1}
I20260619 04:40:05.062568 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.039493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33897 (local address 127.0.0.1:46328)
0619 04:40:05.053476 (+ 13983us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.053498 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.053675 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.054576 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.054580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.054604 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.055082 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.055094 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.057009 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.057017 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.059505 (+ 2488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.059520 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.061730 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.061736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.061910 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.061943 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.062035 (+ 92us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.062159 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13850,"mutex_wait_us":67,"thread_start_us":13688,"threads_started":1}
I20260619 04:40:05.063495 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.038966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:39909 (local address 127.0.0.1:60008)
0619 04:40:05.052994 (+ 14028us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.053020 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.054064 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.054808 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.054814 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.054839 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.055314 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.055326 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.057553 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.057559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.059857 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.059869 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.062673 (+ 2804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.062680 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.062877 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.062906 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.063004 (+ 98us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.063128 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13880,"mutex_wait_us":11,"thread_start_us":14208,"threads_started":1}
I20260619 04:40:05.063531 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.039667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60008 (local address 127.9.224.65:39909)
0619 04:40:05.046927 (+ 7260us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.046941 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.053153 (+ 6212us) server_negotiation.cc:407] Connection header received
0619 04:40:05.054325 (+ 1172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.054335 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.054589 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.054800 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.055505 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.056977 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.060029 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.062151 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.062329 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.062520 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.063076 (+ 556us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.063260 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6985,"thread_start_us":6748,"threads_started":1}
I20260619 04:40:05.065457 18191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.039900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46328 (local address 127.9.224.67:33897)
0619 04:40:05.052255 (+ 12355us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.052268 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.053626 (+ 1358us) server_negotiation.cc:407] Connection header received
0619 04:40:05.053865 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.053877 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.054156 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.054391 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.055264 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.056828 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.059706 (+ 2878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.061189 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.061335 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.061588 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.062115 (+ 527us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.062337 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12123,"thread_start_us":12388,"threads_started":1}
I20260619 04:40:05.065680 17957 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2912e5f24a46a980076bab95246b4b (DEFAULT_TABLE table=test-table [id=fef28da0a00349a6b8993b20133544e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:05.067404 17957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2912e5f24a46a980076bab95246b4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.067492 17817 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2912e5f24a46a980076bab95246b4b (DEFAULT_TABLE table=test-table [id=fef28da0a00349a6b8993b20133544e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:05.068971 17817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2912e5f24a46a980076bab95246b4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.068676 18097 tablet_service.cc:1467] Processing CreateTablet for tablet 9b2912e5f24a46a980076bab95246b4b (DEFAULT_TABLE table=test-table [id=fef28da0a00349a6b8993b20133544e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:05.069887 18097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b2912e5f24a46a980076bab95246b4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.103309 18192 tablet_bootstrap.cc:492] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Bootstrap starting.
I20260619 04:40:05.104475 18193 tablet_bootstrap.cc:492] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Bootstrap starting.
I20260619 04:40:05.105321 18194 tablet_bootstrap.cc:492] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Bootstrap starting.
I20260619 04:40:05.108417 18193 tablet_bootstrap.cc:654] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.108421 18194 tablet_bootstrap.cc:654] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.109452 18194 log.cc:824] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:05.109462 18193 log.cc:824] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:05.114491 18192 tablet_bootstrap.cc:654] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.116271 18192 log.cc:824] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:05.119026 18194 tablet_bootstrap.cc:492] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: No bootstrap required, opened a new log
I20260619 04:40:05.119057 18193 tablet_bootstrap.cc:492] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: No bootstrap required, opened a new log
I20260619 04:40:05.119379 18194 ts_tablet_manager.cc:1397] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260619 04:40:05.119410 18193 ts_tablet_manager.cc:1397] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.007s
I20260619 04:40:05.122653 18192 tablet_bootstrap.cc:492] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: No bootstrap required, opened a new log
I20260619 04:40:05.122960 18192 ts_tablet_manager.cc:1397] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.005s
I20260619 04:40:05.127503 18194 raft_consensus.cc:348] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.127908 18194 raft_consensus.cc:374] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.128046 18194 raft_consensus.cc:729] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.128784 18194 consensus_queue.cc:260] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.130155 18193 raft_consensus.cc:348] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.130704 18193 raft_consensus.cc:374] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.130851 18193 raft_consensus.cc:729] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20bf2ac02f0474986a144fb399c59cf, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.131667 18194 ts_tablet_manager.cc:1428] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent starting tablet: real 0.012s user 0.009s sys 0.002s
I20260619 04:40:05.131494 18193 consensus_queue.cc:260] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.133236 18193 ts_tablet_manager.cc:1428] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
I20260619 04:40:05.134889 18192 raft_consensus.cc:348] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.135360 18192 raft_consensus.cc:374] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.135504 18192 raft_consensus.cc:729] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cea298284014e2cab6c6bacdf860176, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.136128 18192 consensus_queue.cc:260] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.138037 18192 ts_tablet_manager.cc:1428] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260619 04:40:05.233414 17888 tablet.cc:2369] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:40:05.313695 18028 tablet.cc:2369] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:40:05.365465 18168 tablet.cc:2369] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:40:05.411903 18198 raft_consensus.cc:482] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:40:05.412245 18198 raft_consensus.cc:504] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.414013 18198 leader_election.cc:288] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:05.422188 18187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.414496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:47069 (local address 127.9.224.66:36593)
0619 04:40:05.414695 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.414700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.415248 (+ 548us) server_negotiation.cc:407] Connection header received
0619 04:40:05.415531 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.415538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.415628 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.415705 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.416384 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.417250 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.419852 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.421107 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.421282 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.421360 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.421735 (+ 375us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.421934 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 04:40:05.422402 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.414451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36593 (local address 127.9.224.65:47069)
0619 04:40:05.415105 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.415126 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.415304 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.415885 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.415888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.415916 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.416240 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.416247 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.417383 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.417387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.419634 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.419650 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.421332 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.421382 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.421563 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.421590 (+ 27us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.421756 (+ 166us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.421908 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":1,"thread_start_us":332,"threads_started":1}
I20260619 04:40:05.422569 18191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.415411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:41763 (local address 127.9.224.67:33897)
0619 04:40:05.415622 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.415628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.415912 (+ 284us) server_negotiation.cc:407] Connection header received
0619 04:40:05.416142 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.416147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.416205 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.416296 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.416970 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.417802 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.420119 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.421356 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.421544 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.421605 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.422192 (+ 587us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.422349 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:40:05.423378 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.415213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33897 (local address 127.9.224.65:41763)
0619 04:40:05.415798 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.415817 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.415985 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.416322 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.416326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.416349 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.416782 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.416797 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.417937 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.417943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.419960 (+ 2017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.419969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.421826 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.421832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.422007 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.422037 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.422815 (+ 778us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.422958 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":1,"thread_start_us":281,"threads_started":1}
I20260619 04:40:05.423611 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2912e5f24a46a980076bab95246b4b" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf" is_pre_election: true
I20260619 04:40:05.424172 17977 raft_consensus.cc:2454] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:05.424299 18117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2912e5f24a46a980076bab95246b4b" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176" is_pre_election: true
I20260619 04:40:05.424852 17770 leader_election.cc:302] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, d20bf2ac02f0474986a144fb399c59cf; no voters:
I20260619 04:40:05.425045 18117 raft_consensus.cc:2454] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:05.425266 18198 raft_consensus.cc:2781] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:40:05.425452 18198 raft_consensus.cc:482] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:40:05.425595 18198 raft_consensus.cc:3037] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.427958 18198 raft_consensus.cc:504] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.428526 18198 leader_election.cc:288] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Requested vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:05.429196 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2912e5f24a46a980076bab95246b4b" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf"
I20260619 04:40:05.429499 17977 raft_consensus.cc:3037] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.429553 18117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b2912e5f24a46a980076bab95246b4b" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176"
I20260619 04:40:05.429853 18117 raft_consensus.cc:3037] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.432018 17977 raft_consensus.cc:2454] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:05.432338 18117 raft_consensus.cc:2454] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:05.432476 17770 leader_election.cc:302] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, d20bf2ac02f0474986a144fb399c59cf; no voters:
I20260619 04:40:05.432859 18198 raft_consensus.cc:2781] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:05.433363 18198 raft_consensus.cc:686] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Becoming Leader. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Running, Role: LEADER
I20260619 04:40:05.433894 18198 consensus_queue.cc:237] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } }
I20260619 04:40:05.439606 17679 catalog_manager.cc:5495] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65). New cstate: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } health_report { overall_health: HEALTHY } } }
I20260619 04:40:05.525046 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.519036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60020 (local address 127.9.224.65:39909)
0619 04:40:05.519222 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.519228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.519596 (+ 368us) server_negotiation.cc:407] Connection header received
0619 04:40:05.519867 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.519871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.519983 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.520118 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:05.520494 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.521267 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.522817 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.523258 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.523363 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.523827 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:05.524389 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:05.524543 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.524744 (+ 201us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.524830 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 04:40:05.533730 18117 raft_consensus.cc:1261] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:05.533759 17977 raft_consensus.cc:1261] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:05.534847 18203 consensus_queue.cc:1035] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:05.535329 18198 consensus_queue.cc:1035] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:05.547477 18207 mvcc.cc:205] Tried to move back new op lower bound from 7298433046656360448 to 7298433046262190080. Current Snapshot: MvccSnapshot[applied={T|T < 7298433046656360448}]
I20260619 04:40:05.551926 18209 mvcc.cc:205] Tried to move back new op lower bound from 7298433046656360448 to 7298433046262190080. Current Snapshot: MvccSnapshot[applied={T|T < 7298433046656360448 or (T in {7298433046656360448})}]
I20260619 04:40:05.561817 17680 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:05.562079 17680 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:05.565804 17680 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Sending DeleteTablet for 3 replicas of tablet 9b2912e5f24a46a980076bab95246b4b
I20260619 04:40:05.567121 17817 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2912e5f24a46a980076bab95246b4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:05 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60008
I20260619 04:40:05.567435 18097 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2912e5f24a46a980076bab95246b4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:05 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:46328
I20260619 04:40:05.568202 17957 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b2912e5f24a46a980076bab95246b4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:05 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42518
I20260619 04:40:05.568166 17680 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:40:05.568816 17680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:40:05.576853 17816 tablet_service.cc:1467] Processing CreateTablet for tablet 2be0b375e3984a738149b6ded2ed6570 (DEFAULT_TABLE table=test-table [id=e26c14050a8f469da07a93324a63e965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:05.577529 17816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2be0b375e3984a738149b6ded2ed6570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.579639 18217 tablet_replica.cc:330] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: stopping tablet replica
I20260619 04:40:05.580241 18217 raft_consensus.cc:2229] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:40:05.581025 18217 raft_consensus.cc:2258] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:05.583310 17956 tablet_service.cc:1467] Processing CreateTablet for tablet 2be0b375e3984a738149b6ded2ed6570 (DEFAULT_TABLE table=test-table [id=e26c14050a8f469da07a93324a63e965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:05.583828 18217 ts_tablet_manager.cc:1905] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:05.583915 17956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2be0b375e3984a738149b6ded2ed6570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.587055 18096 tablet_service.cc:1467] Processing CreateTablet for tablet 2be0b375e3984a738149b6ded2ed6570 (DEFAULT_TABLE table=test-table [id=e26c14050a8f469da07a93324a63e965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:05.587618 18096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2be0b375e3984a738149b6ded2ed6570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.587845 18194 tablet_bootstrap.cc:492] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Bootstrap starting.
I20260619 04:40:05.589673 18194 tablet_bootstrap.cc:654] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.592036 18193 tablet_bootstrap.cc:492] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Bootstrap starting.
I20260619 04:40:05.593667 18193 tablet_bootstrap.cc:654] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.594795 18192 tablet_bootstrap.cc:492] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Bootstrap starting.
I20260619 04:40:05.597008 18192 tablet_bootstrap.cc:654] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.613145 18217 ts_tablet_manager.cc:1918] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:05.613837 18193 tablet_bootstrap.cc:492] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: No bootstrap required, opened a new log
I20260619 04:40:05.614096 18193 ts_tablet_manager.cc:1397] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.008s
I20260619 04:40:05.615269 18193 raft_consensus.cc:348] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.615622 18193 raft_consensus.cc:374] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.615753 18193 raft_consensus.cc:729] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20bf2ac02f0474986a144fb399c59cf, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.616230 18217 log.cc:1196] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/9b2912e5f24a46a980076bab95246b4b
I20260619 04:40:05.616119 18193 consensus_queue.cc:260] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.617995 18217 ts_tablet_manager.cc:1939] T 9b2912e5f24a46a980076bab95246b4b P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting consensus metadata
I20260619 04:40:05.619498 18193 ts_tablet_manager.cc:1428] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 04:40:05.622762 18219 tablet_replica.cc:330] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: stopping tablet replica
I20260619 04:40:05.622730 17665 catalog_manager.cc:4841] TS 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909): tablet 9b2912e5f24a46a980076bab95246b4b (table test-table [id=fef28da0a00349a6b8993b20133544e6]) successfully deleted
I20260619 04:40:05.623193 18219 raft_consensus.cc:2229] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:05.623677 18219 raft_consensus.cc:2258] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:05.624420 18218 tablet_replica.cc:330] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: stopping tablet replica
I20260619 04:40:05.625236 18194 tablet_bootstrap.cc:492] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: No bootstrap required, opened a new log
I20260619 04:40:05.625396 18194 ts_tablet_manager.cc:1397] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.015s
I20260619 04:40:05.625818 18219 ts_tablet_manager.cc:1905] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:05.626370 18218 raft_consensus.cc:2229] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:05.626474 18194 raft_consensus.cc:348] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.626837 18194 raft_consensus.cc:374] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.626958 18194 raft_consensus.cc:729] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.627235 18194 consensus_queue.cc:260] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.627911 18194 ts_tablet_manager.cc:1428] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 04:40:05.624580 18192 tablet_bootstrap.cc:492] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: No bootstrap required, opened a new log
I20260619 04:40:05.628485 18192 ts_tablet_manager.cc:1397] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.004s
I20260619 04:40:05.628665 18218 raft_consensus.cc:2258] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:05.629609 18192 raft_consensus.cc:348] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.629968 18192 raft_consensus.cc:374] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.630122 18192 raft_consensus.cc:729] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cea298284014e2cab6c6bacdf860176, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.630635 18218 ts_tablet_manager.cc:1905] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:05.630517 18192 consensus_queue.cc:260] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.631358 18192 ts_tablet_manager.cc:1428] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 04:40:05.637357 18219 ts_tablet_manager.cc:1918] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:05.637547 18219 log.cc:1196] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/9b2912e5f24a46a980076bab95246b4b
I20260619 04:40:05.638038 18219 ts_tablet_manager.cc:1939] T 9b2912e5f24a46a980076bab95246b4b P d20bf2ac02f0474986a144fb399c59cf: Deleting consensus metadata
I20260619 04:40:05.638042 18218 ts_tablet_manager.cc:1918] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:05.638221 18218 log.cc:1196] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/9b2912e5f24a46a980076bab95246b4b
I20260619 04:40:05.638761 18218 ts_tablet_manager.cc:1939] T 9b2912e5f24a46a980076bab95246b4b P 8cea298284014e2cab6c6bacdf860176: Deleting consensus metadata
I20260619 04:40:05.639791 17667 catalog_manager.cc:4841] TS d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593): tablet 9b2912e5f24a46a980076bab95246b4b (table test-table [id=fef28da0a00349a6b8993b20133544e6]) successfully deleted
I20260619 04:40:05.640460 17667 catalog_manager.cc:4841] TS 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897): tablet 9b2912e5f24a46a980076bab95246b4b (table test-table [id=fef28da0a00349a6b8993b20133544e6]) successfully deleted
I20260619 04:40:05.692732 18199 raft_consensus.cc:482] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:40:05.692976 18199 raft_consensus.cc:504] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.694695 18199 leader_election.cc:288] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:05.704242 18191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.695790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:46061 (local address 127.9.224.67:33897)
0619 04:40:05.695972 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.695978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.698203 (+ 2225us) server_negotiation.cc:407] Connection header received
0619 04:40:05.698380 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.698393 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.698478 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.698577 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.699172 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.699906 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.701775 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.703113 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.703310 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.703405 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.703804 (+ 399us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.703950 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:40:05.704336 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.695279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:44439 (local address 127.9.224.65:39909)
0619 04:40:05.695516 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.695525 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.696179 (+ 654us) server_negotiation.cc:407] Connection header received
0619 04:40:05.696526 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.696535 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.696662 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.696748 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:05.697944 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.699047 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.701827 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.703182 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.703340 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.703405 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.703913 (+ 508us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.704053 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:40:05.704330 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.695330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33897 (local address 127.9.224.66:46061)
0619 04:40:05.698073 (+ 2743us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.698093 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.698214 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.698607 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.698611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.698637 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.699002 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.699014 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.700051 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.700057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.701605 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.701619 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.703368 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.703375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.703608 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.703653 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.703758 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.703903 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2601,"mutex_wait_us":86,"thread_start_us":1226,"threads_started":1}
I20260619 04:40:05.705158 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.694883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:39909 (local address 127.9.224.66:44439)
0619 04:40:05.696044 (+ 1161us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.696070 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.696324 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.697030 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.697038 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.697075 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:05.697576 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.697592 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.699188 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.699196 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.701612 (+ 2416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.701629 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.703568 (+ 1939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.703573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.703700 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.703749 (+ 49us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.704617 (+ 868us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.704776 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":986,"mutex_wait_us":2,"thread_start_us":2903,"threads_started":1}
I20260619 04:40:05.705765 18117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be0b375e3984a738149b6ded2ed6570" candidate_uuid: "d20bf2ac02f0474986a144fb399c59cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176" is_pre_election: true
I20260619 04:40:05.706059 18117 raft_consensus.cc:2454] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d20bf2ac02f0474986a144fb399c59cf in term 0.
I20260619 04:40:05.706290 17837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be0b375e3984a738149b6ded2ed6570" candidate_uuid: "d20bf2ac02f0474986a144fb399c59cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" is_pre_election: true
I20260619 04:40:05.706607 17910 leader_election.cc:302] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cea298284014e2cab6c6bacdf860176, d20bf2ac02f0474986a144fb399c59cf; no voters:
I20260619 04:40:05.706719 17837 raft_consensus.cc:2454] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d20bf2ac02f0474986a144fb399c59cf in term 0.
I20260619 04:40:05.707046 18199 raft_consensus.cc:2781] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:40:05.707192 18199 raft_consensus.cc:482] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:40:05.707306 18199 raft_consensus.cc:3037] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.709527 18199 raft_consensus.cc:504] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.710377 18199 leader_election.cc:288] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [CANDIDATE]: Term 1 election: Requested vote from peers 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:05.710846 17837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be0b375e3984a738149b6ded2ed6570" candidate_uuid: "d20bf2ac02f0474986a144fb399c59cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40559a4153bc4ce5bff11deaf49e7b5b"
I20260619 04:40:05.711098 17837 raft_consensus.cc:3037] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.711040 18117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be0b375e3984a738149b6ded2ed6570" candidate_uuid: "d20bf2ac02f0474986a144fb399c59cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176"
I20260619 04:40:05.711248 18117 raft_consensus.cc:3037] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.714383 18117 raft_consensus.cc:2454] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d20bf2ac02f0474986a144fb399c59cf in term 1.
I20260619 04:40:05.714422 17837 raft_consensus.cc:2454] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d20bf2ac02f0474986a144fb399c59cf in term 1.
I20260619 04:40:05.714948 17908 leader_election.cc:302] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, d20bf2ac02f0474986a144fb399c59cf; no voters:
I20260619 04:40:05.715363 18199 raft_consensus.cc:2781] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:05.715864 18199 raft_consensus.cc:686] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 1 LEADER]: Becoming Leader. State: Replica: d20bf2ac02f0474986a144fb399c59cf, State: Running, Role: LEADER
I20260619 04:40:05.716316 18199 consensus_queue.cc:237] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.720463 17679 catalog_manager.cc:5495] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf reported cstate change: term changed from 0 to 1, leader changed from <none> to d20bf2ac02f0474986a144fb399c59cf (127.9.224.66). New cstate: current_term: 1 leader_uuid: "d20bf2ac02f0474986a144fb399c59cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } health_report { overall_health: UNKNOWN } } }
Jun 19 04:40:05 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844001, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.126@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:05.797448 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.780933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36933 (local address 127.0.0.1:43146)
0619 04:40:05.781800 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.781829 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.781977 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.782459 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.782463 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.783182 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:05.783457 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.783467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.785086 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.785090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.786164 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.786176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.787203 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.787208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.787358 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.788204 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:05.788223 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:05.791106 (+ 2883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:05.794976 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:05.794988 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:05.794994 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:05.795401 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:05.795800 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:05.795803 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:05.795806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:05.795974 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:05.796592 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:05.796599 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:05.796745 (+ 146us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.796915 (+ 170us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.797141 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"thread_start_us":574,"threads_started":1}
I20260619 04:40:05.797797 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.780933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43146 (local address 127.9.224.126:36933)
0619 04:40:05.781583 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.781590 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.781929 (+ 339us) server_negotiation.cc:407] Connection header received
0619 04:40:05.782093 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.782099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.782214 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.782369 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:05.783690 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.784893 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.786370 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.787020 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.787143 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.791365 (+ 4222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:05.791373 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:05.791378 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:05.791421 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:05.794825 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:05.795528 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:05.795535 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:05.795539 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:05.795690 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:05.796081 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:05.796086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:05.796089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:05.796471 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:05.796622 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.797026 (+ 404us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.797366 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":484,"thread_start_us":315,"threads_started":1}
I20260619 04:40:05.803252 17679 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:43146:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 04:40:05.804590 17679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:40:05.812252 17816 tablet_service.cc:1467] Processing CreateTablet for tablet b071dd2d0cf645f892e3c6f985821ee3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=915325a5c68e4cd5b3f0fd3275a70061]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:40:05.812233 17957 tablet_service.cc:1467] Processing CreateTablet for tablet b071dd2d0cf645f892e3c6f985821ee3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=915325a5c68e4cd5b3f0fd3275a70061]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:40:05.812572 18097 tablet_service.cc:1467] Processing CreateTablet for tablet b071dd2d0cf645f892e3c6f985821ee3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=915325a5c68e4cd5b3f0fd3275a70061]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 04:40:05.812825 17816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b071dd2d0cf645f892e3c6f985821ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.812870 17957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b071dd2d0cf645f892e3c6f985821ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.813129 18097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b071dd2d0cf645f892e3c6f985821ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:05.820972 18193 tablet_bootstrap.cc:492] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: Bootstrap starting.
I20260619 04:40:05.821547 18194 tablet_bootstrap.cc:492] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: Bootstrap starting.
I20260619 04:40:05.822957 18193 tablet_bootstrap.cc:654] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.822999 18192 tablet_bootstrap.cc:492] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: Bootstrap starting.
I20260619 04:40:05.823465 18194 tablet_bootstrap.cc:654] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.825132 18192 tablet_bootstrap.cc:654] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:05.836724 18192 tablet_bootstrap.cc:492] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: No bootstrap required, opened a new log
I20260619 04:40:05.837020 18192 ts_tablet_manager.cc:1397] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260619 04:40:05.837534 18193 tablet_bootstrap.cc:492] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: No bootstrap required, opened a new log
I20260619 04:40:05.837718 18193 ts_tablet_manager.cc:1397] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.007s
I20260619 04:40:05.838065 18192 raft_consensus.cc:348] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.838449 18192 raft_consensus.cc:374] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.838580 18192 raft_consensus.cc:729] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cea298284014e2cab6c6bacdf860176, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.838476 18193 raft_consensus.cc:348] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.838719 18193 raft_consensus.cc:374] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.838800 18193 raft_consensus.cc:729] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20bf2ac02f0474986a144fb399c59cf, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.839048 18193 consensus_queue.cc:260] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.839040 18192 consensus_queue.cc:260] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.839485 18199 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.839773 18199 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:05.839542 18200 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.839882 18200 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:05.840408 18192 ts_tablet_manager.cc:1428] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 04:40:05.840758 18194 tablet_bootstrap.cc:492] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: No bootstrap required, opened a new log
I20260619 04:40:05.840938 18194 ts_tablet_manager.cc:1397] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.005s
I20260619 04:40:05.841673 18194 raft_consensus.cc:348] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.841923 18194 raft_consensus.cc:374] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:05.841992 18194 raft_consensus.cc:729] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Initialized, Role: FOLLOWER
I20260619 04:40:05.842257 18194 consensus_queue.cc:260] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.842712 18214 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.843107 18214 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:05.843492 18194 ts_tablet_manager.cc:1428] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 04:40:05.844767 18193 ts_tablet_manager.cc:1428] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260619 04:40:05.912111 18214 raft_consensus.cc:482] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:40:05.912393 18214 raft_consensus.cc:504] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.913076 18214 leader_election.cc:288] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:05.913770 18117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b071dd2d0cf645f892e3c6f985821ee3" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176" is_pre_election: true
I20260619 04:40:05.913790 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b071dd2d0cf645f892e3c6f985821ee3" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf" is_pre_election: true
I20260619 04:40:05.914074 18117 raft_consensus.cc:2454] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:05.914069 17977 raft_consensus.cc:2454] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:05.914608 17770 leader_election.cc:302] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, d20bf2ac02f0474986a144fb399c59cf; no voters:
I20260619 04:40:05.914924 18214 raft_consensus.cc:2781] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:40:05.915081 18214 raft_consensus.cc:482] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:40:05.915199 18214 raft_consensus.cc:3037] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.917593 18214 raft_consensus.cc:504] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.918211 18214 leader_election.cc:288] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Requested vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:05.918838 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b071dd2d0cf645f892e3c6f985821ee3" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf"
I20260619 04:40:05.918859 18117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b071dd2d0cf645f892e3c6f985821ee3" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176"
I20260619 04:40:05.919075 17977 raft_consensus.cc:3037] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.919098 18117 raft_consensus.cc:3037] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:05.921087 18117 raft_consensus.cc:2454] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:05.921550 17770 leader_election.cc:302] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, 8cea298284014e2cab6c6bacdf860176; no voters:
I20260619 04:40:05.921859 18214 raft_consensus.cc:2781] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:05.922245 18214 raft_consensus.cc:686] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Becoming Leader. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Running, Role: LEADER
I20260619 04:40:05.922214 17977 raft_consensus.cc:2454] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:05.922549 18214 consensus_queue.cc:237] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:05.924552 18203 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: TxnStatusTablet state changed. Reason: New leader 40559a4153bc4ce5bff11deaf49e7b5b. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.924815 18203 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:40:05.925460 18238 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 04:40:05.925742 18238 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 04:40:05.926388 17679 catalog_manager.cc:5495] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65). New cstate: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } health_report { overall_health: UNKNOWN } } }
I20260619 04:40:05.965404 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.959815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60034 (local address 127.9.224.65:39909)
0619 04:40:05.960059 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.960065 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.960087 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:40:05.960317 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.960323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.960412 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.960536 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:05.960935 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.961780 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.963256 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.963825 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.963995 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.964466 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:05.964619 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:05.964728 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:05.964907 (+ 179us) server_negotiation.cc:299] Negotiation successful
0619 04:40:05.964996 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260619 04:40:05.965404 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.959657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:39909 (local address 127.0.0.1:60034)
0619 04:40:05.959893 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:05.959920 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:05.960092 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:05.960558 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:05.960563 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:05.960576 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:40:05.960781 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.960790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.961935 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.961943 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.963087 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:05.963100 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.964011 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.964017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:05.964200 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:05.964267 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:40:05.964743 (+ 476us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:40:05.964782 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 04:40:05.964883 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 04:40:05.965050 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260619 04:40:05.969749 17977 raft_consensus.cc:1261] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:05.969839 18117 raft_consensus.cc:1261] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:05.970450 18214 consensus_queue.cc:1035] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:05.970824 18203 consensus_queue.cc:1035] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:05.974478 18200 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: TxnStatusTablet state changed. Reason: New leader 40559a4153bc4ce5bff11deaf49e7b5b. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.974732 18200 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:05.976414 18198 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.976699 18198 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:40:05.978147 18208 mvcc.cc:205] Tried to move back new op lower bound from 7298433048445239296 to 7298433048261967872. Current Snapshot: MvccSnapshot[applied={T|T < 7298433048445239296}]
I20260619 04:40:05.978479 18200 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.978713 18200 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 8cea298284014e2cab6c6bacdf860176: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:05.985006 18199 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: TxnStatusTablet state changed. Reason: New leader 40559a4153bc4ce5bff11deaf49e7b5b. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.985327 18199 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:05.987290 18198 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.987610 18198 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P 40559a4153bc4ce5bff11deaf49e7b5b: This TxnStatusTablet replica's current role is: LEADER
I20260619 04:40:05.990396 18199 tablet_replica.cc:439] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } } }
I20260619 04:40:05.990788 18199 tablet_replica.cc:442] T b071dd2d0cf645f892e3c6f985821ee3 P d20bf2ac02f0474986a144fb399c59cf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 04:40:06.001566 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:05.984222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42526 (local address 127.9.224.66:36593)
0619 04:40:05.995207 (+ 10985us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:05.995213 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:05.995240 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:40:05.995377 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:05.995384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:05.995499 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:05.995709 (+ 210us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:05.996160 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.997340 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.998839 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:05.999544 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:05.999686 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.000127 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.000905 (+ 778us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.001058 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.001112 (+ 54us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.001199 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10818,"thread_start_us":10665,"threads_started":1}
I20260619 04:40:06.018507 18245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.012657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:39909 (local address 127.9.224.66:51163)
0619 04:40:06.013319 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:06.013334 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:06.013515 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:06.013854 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:06.013859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:06.013870 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:40:06.014166 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:06.014174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.015304 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.015310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:06.016428 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:06.016439 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.017230 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.017238 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:06.017378 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.017440 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.017858 (+ 418us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.017870 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 04:40:06.017957 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 04:40:06.018120 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":407,"threads_started":1}
I20260619 04:40:06.018525 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.012757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:51163 (local address 127.9.224.65:39909)
0619 04:40:06.012946 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.012950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.013441 (+ 491us) server_negotiation.cc:407] Connection header received
0619 04:40:06.013653 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.013664 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.013734 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.013839 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:06.014335 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.015168 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.016571 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.017040 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.017174 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.017629 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.017752 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.017857 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.018038 (+ 181us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.018143 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:40:06.028488 18117 raft_consensus.cc:1261] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Refusing update from remote peer d20bf2ac02f0474986a144fb399c59cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:06.029346 17837 raft_consensus.cc:1261] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Refusing update from remote peer d20bf2ac02f0474986a144fb399c59cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:06.029825 18199 consensus_queue.cc:1035] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:06.030139 18225 consensus_queue.cc:1035] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:06.069164 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.058210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:44909 (local address 127.9.224.66:36593)
0619 04:40:06.058538 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.058547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.062959 (+ 4412us) server_negotiation.cc:407] Connection header received
0619 04:40:06.063165 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.063171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.063260 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.063362 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:06.064084 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.065177 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.067101 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.067726 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.067861 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.068325 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.068469 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.068559 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.068857 (+ 298us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.068929 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260619 04:40:06.069427 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.058193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:36593 (local address 127.9.224.65:44909)
0619 04:40:06.062827 (+ 4634us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:06.062849 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:06.063016 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:06.063400 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:06.063405 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:06.063442 (+ 37us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:40:06.063925 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:06.063940 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.065306 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.065315 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:06.066939 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:06.066955 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.067908 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.067918 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:06.068057 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.068162 (+ 105us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.068726 (+ 564us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.068746 (+ 20us) client_negotiation.cc:769] Sending connection context
0619 04:40:06.068836 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 04:40:06.069003 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4401,"thread_start_us":4219,"threads_started":1}
I20260619 04:40:06.115485 17678 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:06.115773 17678 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:06.119612 17678 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Sending DeleteTablet for 3 replicas of tablet 2be0b375e3984a738149b6ded2ed6570
I20260619 04:40:06.120463 17816 tablet_service.cc:1514] Processing DeleteTablet for tablet 2be0b375e3984a738149b6ded2ed6570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60008
I20260619 04:40:06.120762 18217 tablet_replica.cc:330] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: stopping tablet replica
I20260619 04:40:06.120846 17957 tablet_service.cc:1514] Processing DeleteTablet for tablet 2be0b375e3984a738149b6ded2ed6570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42518
I20260619 04:40:06.120980 18217 raft_consensus.cc:2229] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:06.121126 18219 tablet_replica.cc:330] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: stopping tablet replica
I20260619 04:40:06.121186 18217 raft_consensus.cc:2258] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.121378 18219 raft_consensus.cc:2229] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:40:06.121928 18219 raft_consensus.cc:2258] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.123240 18219 ts_tablet_manager.cc:1905] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.123588 18217 ts_tablet_manager.cc:1905] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.126518 18097 tablet_service.cc:1514] Processing DeleteTablet for tablet 2be0b375e3984a738149b6ded2ed6570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:46328
I20260619 04:40:06.126824 18218 tablet_replica.cc:330] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: stopping tablet replica
I20260619 04:40:06.127049 18218 raft_consensus.cc:2229] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:06.127257 18218 raft_consensus.cc:2258] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.128435 18218 ts_tablet_manager.cc:1905] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.131760 18219 ts_tablet_manager.cc:1918] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:40:06.131996 18219 log.cc:1196] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/2be0b375e3984a738149b6ded2ed6570
I20260619 04:40:06.132519 18219 ts_tablet_manager.cc:1939] T 2be0b375e3984a738149b6ded2ed6570 P d20bf2ac02f0474986a144fb399c59cf: Deleting consensus metadata
I20260619 04:40:06.134511 17667 catalog_manager.cc:4841] TS d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593): tablet 2be0b375e3984a738149b6ded2ed6570 (table test-table [id=e26c14050a8f469da07a93324a63e965]) successfully deleted
I20260619 04:40:06.135859 18218 ts_tablet_manager.cc:1918] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:40:06.136057 18218 log.cc:1196] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/2be0b375e3984a738149b6ded2ed6570
I20260619 04:40:06.137604 18218 ts_tablet_manager.cc:1939] T 2be0b375e3984a738149b6ded2ed6570 P 8cea298284014e2cab6c6bacdf860176: Deleting consensus metadata
I20260619 04:40:06.138772 17667 catalog_manager.cc:4841] TS 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897): tablet 2be0b375e3984a738149b6ded2ed6570 (table test-table [id=e26c14050a8f469da07a93324a63e965]) successfully deleted
I20260619 04:40:06.148358 18217 ts_tablet_manager.cc:1918] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:40:06.148650 18217 log.cc:1196] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/2be0b375e3984a738149b6ded2ed6570
I20260619 04:40:06.149307 18217 ts_tablet_manager.cc:1939] T 2be0b375e3984a738149b6ded2ed6570 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting consensus metadata
I20260619 04:40:06.150661 17665 catalog_manager.cc:4841] TS 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909): tablet 2be0b375e3984a738149b6ded2ed6570 (table test-table [id=e26c14050a8f469da07a93324a63e965]) successfully deleted
Jun 19 04:40:06 dist-test-slave-9dgf krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 04:40:06 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:06 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 04:40:06.211807 18232 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:06.197296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43154 (local address 127.9.224.126:36933)
0619 04:40:06.197534 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.197541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.198094 (+ 553us) server_negotiation.cc:407] Connection header received
0619 04:40:06.198304 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.198311 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.198401 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.198516 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:06.200231 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.201416 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.203411 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.204098 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.204231 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.211536 (+ 7305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43154: BlockingRecv error: recv got EOF from 127.0.0.1:43154 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Jun 19 04:40:06 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM
I20260619 04:40:06.234966 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.216163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43170 (local address 127.9.224.126:36933)
0619 04:40:06.216344 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.216350 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.216567 (+ 217us) server_negotiation.cc:407] Connection header received
0619 04:40:06.216774 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.216781 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.216866 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.216978 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:06.218841 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.220025 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.222133 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.222844 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.222984 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.228134 (+ 5150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:06.228141 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:06.228147 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:06.228197 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:06.231872 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:06.232728 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:06.232734 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:06.232738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:06.232918 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:06.233341 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:06.233346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:06.233350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:06.233702 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:06.233970 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.234332 (+ 362us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.234579 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 04:40:06.239228 17678 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:40:06.239974 17678 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:40:06.247716 17816 tablet_service.cc:1467] Processing CreateTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 (DEFAULT_TABLE table=test-table [id=8b9f907e78f84621a48fb8def0961cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:06.247859 17957 tablet_service.cc:1467] Processing CreateTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 (DEFAULT_TABLE table=test-table [id=8b9f907e78f84621a48fb8def0961cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:06.248279 17816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70efc0136c14f3c9c58cd405a69b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:06.248345 17957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70efc0136c14f3c9c58cd405a69b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:06.255018 18097 tablet_service.cc:1467] Processing CreateTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 (DEFAULT_TABLE table=test-table [id=8b9f907e78f84621a48fb8def0961cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:06.255491 18097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70efc0136c14f3c9c58cd405a69b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:06.255754 18193 tablet_bootstrap.cc:492] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Bootstrap starting.
I20260619 04:40:06.257602 18193 tablet_bootstrap.cc:654] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:06.266608 18192 tablet_bootstrap.cc:492] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Bootstrap starting.
I20260619 04:40:06.268414 18192 tablet_bootstrap.cc:654] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:06.272051 18194 tablet_bootstrap.cc:492] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Bootstrap starting.
I20260619 04:40:06.273952 18194 tablet_bootstrap.cc:654] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:06.284792 18192 tablet_bootstrap.cc:492] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: No bootstrap required, opened a new log
I20260619 04:40:06.285665 18192 ts_tablet_manager.cc:1397] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260619 04:40:06.286641 18192 raft_consensus.cc:348] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.287067 18192 raft_consensus.cc:374] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:06.287213 18192 raft_consensus.cc:729] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cea298284014e2cab6c6bacdf860176, State: Initialized, Role: FOLLOWER
I20260619 04:40:06.287534 18192 consensus_queue.cc:260] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.290024 18192 ts_tablet_manager.cc:1428] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 04:40:06.296195 18193 tablet_bootstrap.cc:492] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: No bootstrap required, opened a new log
I20260619 04:40:06.296402 18193 ts_tablet_manager.cc:1397] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Time spent bootstrapping tablet: real 0.041s user 0.019s sys 0.019s
I20260619 04:40:06.297297 18193 raft_consensus.cc:348] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.297605 18193 raft_consensus.cc:374] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:06.297701 18193 raft_consensus.cc:729] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20bf2ac02f0474986a144fb399c59cf, State: Initialized, Role: FOLLOWER
I20260619 04:40:06.297931 18193 consensus_queue.cc:260] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.299175 18193 ts_tablet_manager.cc:1428] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260619 04:40:06.303637 18194 tablet_bootstrap.cc:492] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: No bootstrap required, opened a new log
I20260619 04:40:06.303822 18194 ts_tablet_manager.cc:1397] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.008s
I20260619 04:40:06.304728 18194 raft_consensus.cc:348] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.305039 18194 raft_consensus.cc:374] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:06.305142 18194 raft_consensus.cc:729] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Initialized, Role: FOLLOWER
I20260619 04:40:06.305435 18194 consensus_queue.cc:260] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.306062 18194 ts_tablet_manager.cc:1428] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 04:40:06.442075 18203 raft_consensus.cc:482] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:40:06.442382 18203 raft_consensus.cc:504] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.443264 18203 leader_election.cc:288] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:06.444031 18116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70efc0136c14f3c9c58cd405a69b7a8" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176" is_pre_election: true
I20260619 04:40:06.444038 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70efc0136c14f3c9c58cd405a69b7a8" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf" is_pre_election: true
I20260619 04:40:06.444310 18116 raft_consensus.cc:2454] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:06.444329 17977 raft_consensus.cc:2454] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:06.444928 17770 leader_election.cc:302] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, d20bf2ac02f0474986a144fb399c59cf; no voters:
I20260619 04:40:06.445320 18203 raft_consensus.cc:2781] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:40:06.445461 18203 raft_consensus.cc:482] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:40:06.445566 18203 raft_consensus.cc:3037] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:06.449461 18203 raft_consensus.cc:504] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.450299 18203 leader_election.cc:288] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Requested vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:06.450987 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70efc0136c14f3c9c58cd405a69b7a8" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf"
I20260619 04:40:06.451043 18116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70efc0136c14f3c9c58cd405a69b7a8" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176"
I20260619 04:40:06.451231 17977 raft_consensus.cc:3037] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:06.451278 18116 raft_consensus.cc:3037] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:06.454360 18116 raft_consensus.cc:2454] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:06.454614 17977 raft_consensus.cc:2454] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:06.454923 17770 leader_election.cc:302] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, 8cea298284014e2cab6c6bacdf860176; no voters:
I20260619 04:40:06.455571 18203 raft_consensus.cc:2781] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:06.455884 18203 raft_consensus.cc:686] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Becoming Leader. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Running, Role: LEADER
I20260619 04:40:06.456339 18203 consensus_queue.cc:237] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.459892 17679 catalog_manager.cc:5495] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65). New cstate: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } health_report { overall_health: UNKNOWN } } }
I20260619 04:40:06.481014 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.474468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.9.224.65:39909)
0619 04:40:06.474659 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.474665 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.474686 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:40:06.474757 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.474762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.474853 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.474963 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:06.475415 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.476633 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.478682 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.479378 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.479526 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.480108 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.480300 (+ 192us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.480412 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.480598 (+ 186us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.480699 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:40:06.484851 17977 raft_consensus.cc:1261] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:06.484845 18116 raft_consensus.cc:1261] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:06.485592 18214 consensus_queue.cc:1035] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:06.485884 18203 consensus_queue.cc:1035] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:06.509608 17678 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:06.509896 17678 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:06.516518 17678 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Sending DeleteTablet for 3 replicas of tablet b70efc0136c14f3c9c58cd405a69b7a8
I20260619 04:40:06.517553 17816 tablet_service.cc:1514] Processing DeleteTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60008
I20260619 04:40:06.518308 17957 tablet_service.cc:1514] Processing DeleteTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42518
I20260619 04:40:06.518318 18097 tablet_service.cc:1514] Processing DeleteTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:46328
I20260619 04:40:06.518638 18217 tablet_replica.cc:330] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: stopping tablet replica
I20260619 04:40:06.518875 18217 raft_consensus.cc:2229] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:40:06.519240 18217 raft_consensus.cc:2258] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.519562 17956 tablet_service.cc:1514] Processing DeleteTablet for tablet b70efc0136c14f3c9c58cd405a69b7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42518
I20260619 04:40:06.519840 18219 tablet_replica.cc:330] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: stopping tablet replica
I20260619 04:40:06.520013 18219 raft_consensus.cc:2229] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:06.520253 18219 raft_consensus.cc:2258] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.520429 18217 ts_tablet_manager.cc:1905] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.520543 18218 tablet_replica.cc:330] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: stopping tablet replica
I20260619 04:40:06.520720 18218 raft_consensus.cc:2229] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:06.520946 18218 raft_consensus.cc:2258] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.524204 17678 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:40:06.524860 17678 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:40:06.528731 18217 ts_tablet_manager.cc:1918] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:06.529163 18217 log.cc:1196] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/b70efc0136c14f3c9c58cd405a69b7a8
I20260619 04:40:06.529953 18218 ts_tablet_manager.cc:1905] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.534077 17956 tablet_service.cc:1467] Processing CreateTablet for tablet 9873b59084c84e65a1402f5568958c61 (DEFAULT_TABLE table=test-table [id=32ed851770a34d419084bc39a25fa365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:06.534469 18097 tablet_service.cc:1467] Processing CreateTablet for tablet 9873b59084c84e65a1402f5568958c61 (DEFAULT_TABLE table=test-table [id=32ed851770a34d419084bc39a25fa365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:06.534575 17956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9873b59084c84e65a1402f5568958c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:06.535156 18097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9873b59084c84e65a1402f5568958c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:06.545006 18218 ts_tablet_manager.cc:1918] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:06.545894 18193 tablet_bootstrap.cc:492] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Bootstrap starting.
I20260619 04:40:06.545387 18192 tablet_bootstrap.cc:492] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Bootstrap starting.
I20260619 04:40:06.547663 18193 tablet_bootstrap.cc:654] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:06.547706 18192 tablet_bootstrap.cc:654] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:06.551712 18218 log.cc:1196] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b70efc0136c14f3c9c58cd405a69b7a8
I20260619 04:40:06.552444 18218 ts_tablet_manager.cc:1939] T b70efc0136c14f3c9c58cd405a69b7a8 P 8cea298284014e2cab6c6bacdf860176: Deleting consensus metadata
I20260619 04:40:06.554162 17667 catalog_manager.cc:4841] TS 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897): tablet b70efc0136c14f3c9c58cd405a69b7a8 (table test-table [id=8b9f907e78f84621a48fb8def0961cc1]) successfully deleted
I20260619 04:40:06.554589 18219 ts_tablet_manager.cc:1905] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.533667 17816 tablet_service.cc:1467] Processing CreateTablet for tablet 9873b59084c84e65a1402f5568958c61 (DEFAULT_TABLE table=test-table [id=32ed851770a34d419084bc39a25fa365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:06.555179 17816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9873b59084c84e65a1402f5568958c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:06.555702 18217 ts_tablet_manager.cc:1939] T b70efc0136c14f3c9c58cd405a69b7a8 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting consensus metadata
I20260619 04:40:06.558691 17665 catalog_manager.cc:4841] TS 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909): tablet b70efc0136c14f3c9c58cd405a69b7a8 (table test-table [id=8b9f907e78f84621a48fb8def0961cc1]) successfully deleted
I20260619 04:40:06.559724 18192 tablet_bootstrap.cc:492] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: No bootstrap required, opened a new log
I20260619 04:40:06.559906 18192 ts_tablet_manager.cc:1397] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260619 04:40:06.560719 18192 raft_consensus.cc:348] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.560981 18192 raft_consensus.cc:374] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:06.561066 18192 raft_consensus.cc:729] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cea298284014e2cab6c6bacdf860176, State: Initialized, Role: FOLLOWER
I20260619 04:40:06.561316 18192 consensus_queue.cc:260] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.561880 18192 ts_tablet_manager.cc:1428] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 04:40:06.563113 18194 tablet_bootstrap.cc:492] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Bootstrap starting.
I20260619 04:40:06.563196 18193 tablet_bootstrap.cc:492] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: No bootstrap required, opened a new log
I20260619 04:40:06.563411 18193 ts_tablet_manager.cc:1397] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260619 04:40:06.564239 18193 raft_consensus.cc:348] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.564523 18193 raft_consensus.cc:374] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:06.564605 18193 raft_consensus.cc:729] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20bf2ac02f0474986a144fb399c59cf, State: Initialized, Role: FOLLOWER
I20260619 04:40:06.564868 18194 tablet_bootstrap.cc:654] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:06.564862 18193 consensus_queue.cc:260] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.565305 18219 ts_tablet_manager.cc:1918] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:06.565467 18193 ts_tablet_manager.cc:1428] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 04:40:06.565476 18219 log.cc:1196] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b70efc0136c14f3c9c58cd405a69b7a8
I20260619 04:40:06.567521 18219 ts_tablet_manager.cc:1939] T b70efc0136c14f3c9c58cd405a69b7a8 P d20bf2ac02f0474986a144fb399c59cf: Deleting consensus metadata
I20260619 04:40:06.569255 17667 catalog_manager.cc:4841] TS d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593): tablet b70efc0136c14f3c9c58cd405a69b7a8 (table test-table [id=8b9f907e78f84621a48fb8def0961cc1]) successfully deleted
W20260619 04:40:06.569885 17667 catalog_manager.cc:4808] TS d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593): delete failed for tablet b70efc0136c14f3c9c58cd405a69b7a8 because the tablet was not found. No further retry: Not found: Tablet not found: b70efc0136c14f3c9c58cd405a69b7a8
I20260619 04:40:06.570950 18194 tablet_bootstrap.cc:492] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: No bootstrap required, opened a new log
I20260619 04:40:06.571126 18194 ts_tablet_manager.cc:1397] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260619 04:40:06.571974 18194 raft_consensus.cc:348] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.572237 18194 raft_consensus.cc:374] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:06.572309 18194 raft_consensus.cc:729] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Initialized, Role: FOLLOWER
I20260619 04:40:06.572588 18194 consensus_queue.cc:260] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.573227 18194 ts_tablet_manager.cc:1428] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 04:40:06.632180 18198 raft_consensus.cc:482] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:40:06.632428 18198 raft_consensus.cc:504] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.633090 18198 leader_election.cc:288] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:06.633610 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9873b59084c84e65a1402f5568958c61" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf" is_pre_election: true
I20260619 04:40:06.633747 18116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9873b59084c84e65a1402f5568958c61" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176" is_pre_election: true
I20260619 04:40:06.633862 17977 raft_consensus.cc:2454] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:06.634003 18116 raft_consensus.cc:2454] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 0.
I20260619 04:40:06.634466 17770 leader_election.cc:302] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, 8cea298284014e2cab6c6bacdf860176; no voters:
I20260619 04:40:06.634791 18198 raft_consensus.cc:2781] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:40:06.634917 18198 raft_consensus.cc:482] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:40:06.635030 18198 raft_consensus.cc:3037] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:06.637123 18198 raft_consensus.cc:504] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.637673 18198 leader_election.cc:288] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Requested vote from peers d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593), 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897)
I20260619 04:40:06.638352 18116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9873b59084c84e65a1402f5568958c61" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cea298284014e2cab6c6bacdf860176"
I20260619 04:40:06.638362 17977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9873b59084c84e65a1402f5568958c61" candidate_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20bf2ac02f0474986a144fb399c59cf"
I20260619 04:40:06.638569 18116 raft_consensus.cc:3037] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:06.638582 17977 raft_consensus.cc:3037] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:06.640820 18116 raft_consensus.cc:2454] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:06.641327 17770 leader_election.cc:302] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40559a4153bc4ce5bff11deaf49e7b5b, 8cea298284014e2cab6c6bacdf860176; no voters:
I20260619 04:40:06.641629 18198 raft_consensus.cc:2781] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:06.641961 17977 raft_consensus.cc:2454] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40559a4153bc4ce5bff11deaf49e7b5b in term 1.
I20260619 04:40:06.641805 18198 raft_consensus.cc:686] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Becoming Leader. State: Replica: 40559a4153bc4ce5bff11deaf49e7b5b, State: Running, Role: LEADER
I20260619 04:40:06.642469 18198 consensus_queue.cc:237] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } }
I20260619 04:40:06.645241 17679 catalog_manager.cc:5495] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65). New cstate: current_term: 1 leader_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40559a4153bc4ce5bff11deaf49e7b5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 } health_report { overall_health: UNKNOWN } } }
I20260619 04:40:06.676167 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.670774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:42561 (local address 127.9.224.65:39909)
0619 04:40:06.670981 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.670988 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.671179 (+ 191us) server_negotiation.cc:407] Connection header received
0619 04:40:06.671318 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.671324 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.671400 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.671494 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:06.671962 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.672848 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.674394 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.674816 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.674958 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.675385 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.675494 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.675590 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.675721 (+ 131us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.675789 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":40}
I20260619 04:40:06.676190 18278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.670574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:39909 (local address 127.9.224.65:42561)
0619 04:40:06.671077 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:06.671092 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:06.671207 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:06.671544 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:06.671547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:06.671557 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 04:40:06.671795 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:06.671803 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.672980 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.672984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:06.674162 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:06.674175 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.674972 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.674977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:06.675188 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.675225 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 04:40:06.675588 (+ 363us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 04:40:06.675599 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 04:40:06.675693 (+ 94us) client_negotiation.cc:240] Negotiation successful
0619 04:40:06.675836 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":44,"thread_start_us":415,"threads_started":1}
I20260619 04:40:06.684166 18116 raft_consensus.cc:1261] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:06.684288 17977 raft_consensus.cc:1261] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Refusing update from remote peer 40559a4153bc4ce5bff11deaf49e7b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:06.684744 18203 consensus_queue.cc:1035] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cea298284014e2cab6c6bacdf860176" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:06.685112 18198 consensus_queue.cc:1035] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20bf2ac02f0474986a144fb399c59cf" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 36593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:06.737409 17679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:06.737697 17679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:06.741268 17679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfe51b5527a94c4781bf8f4b351901b5: Sending DeleteTablet for 3 replicas of tablet 9873b59084c84e65a1402f5568958c61
I20260619 04:40:06.742388 17956 tablet_service.cc:1514] Processing DeleteTablet for tablet 9873b59084c84e65a1402f5568958c61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:42518
I20260619 04:40:06.742969 18219 tablet_replica.cc:330] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: stopping tablet replica
I20260619 04:40:06.743005 18097 tablet_service.cc:1514] Processing DeleteTablet for tablet 9873b59084c84e65a1402f5568958c61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:46328
I20260619 04:40:06.743228 18219 raft_consensus.cc:2229] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:06.743468 18218 tablet_replica.cc:330] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: stopping tablet replica
I20260619 04:40:06.743463 18219 raft_consensus.cc:2258] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.743713 18218 raft_consensus.cc:2229] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:06.743928 18218 raft_consensus.cc:2258] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.745030 18219 ts_tablet_manager.cc:1905] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.745430 18218 ts_tablet_manager.cc:1905] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.750350 18219 ts_tablet_manager.cc:1918] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:40:06.750535 18219 log.cc:1196] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/9873b59084c84e65a1402f5568958c61
I20260619 04:40:06.750546 18218 ts_tablet_manager.cc:1918] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:40:06.750710 18218 log.cc:1196] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/9873b59084c84e65a1402f5568958c61
I20260619 04:40:06.750948 18219 ts_tablet_manager.cc:1939] T 9873b59084c84e65a1402f5568958c61 P d20bf2ac02f0474986a144fb399c59cf: Deleting consensus metadata
I20260619 04:40:06.751164 18218 ts_tablet_manager.cc:1939] T 9873b59084c84e65a1402f5568958c61 P 8cea298284014e2cab6c6bacdf860176: Deleting consensus metadata
I20260619 04:40:06.752164 17816 tablet_service.cc:1514] Processing DeleteTablet for tablet 9873b59084c84e65a1402f5568958c61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:06 UTC) from {username='oryx', principal='oryx/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60008
I20260619 04:40:06.752214 17667 catalog_manager.cc:4841] TS 8cea298284014e2cab6c6bacdf860176 (127.9.224.67:33897): tablet 9873b59084c84e65a1402f5568958c61 (table test-table [id=32ed851770a34d419084bc39a25fa365]) successfully deleted
I20260619 04:40:06.752257 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 17751
I20260619 04:40:06.752471 18217 tablet_replica.cc:330] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: stopping tablet replica
I20260619 04:40:06.752502 17667 catalog_manager.cc:4841] TS d20bf2ac02f0474986a144fb399c59cf (127.9.224.66:36593): tablet 9873b59084c84e65a1402f5568958c61 (table test-table [id=32ed851770a34d419084bc39a25fa365]) successfully deleted
I20260619 04:40:06.752678 18217 raft_consensus.cc:2229] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:40:06.753026 18217 raft_consensus.cc:2258] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:06.754124 18217 ts_tablet_manager.cc:1905] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:06.759312 18217 ts_tablet_manager.cc:1918] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 04:40:06.759492 18217 log.cc:1196] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/9873b59084c84e65a1402f5568958c61
I20260619 04:40:06.759979 18217 ts_tablet_manager.cc:1939] T 9873b59084c84e65a1402f5568958c61 P 40559a4153bc4ce5bff11deaf49e7b5b: Deleting consensus metadata
I20260619 04:40:06.761181 17665 catalog_manager.cc:4841] TS 40559a4153bc4ce5bff11deaf49e7b5b (127.9.224.65:39909): tablet 9873b59084c84e65a1402f5568958c61 (table test-table [id=32ed851770a34d419084bc39a25fa365]) successfully deleted
Jun 19 04:40:06 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.65@KRBTEST.COM
I20260619 04:40:06.776897 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.753759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60040 (local address 127.9.224.65:39909)
0619 04:40:06.753936 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.753942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.760138 (+ 6196us) server_negotiation.cc:407] Connection header received
0619 04:40:06.760418 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.760424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.760506 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.760622 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:06.762073 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.763213 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.764441 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.765073 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.765199 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.769356 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:06.769377 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:06.769398 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:06.769445 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:06.773383 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:06.774393 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:06.774409 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:06.774416 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:06.774569 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:06.775072 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:06.775077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:06.775081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:06.775502 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:06.775899 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.776235 (+ 336us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.776513 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 04:40:06.777608 17882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:06.941536 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 17751
I20260619 04:40:06.968573 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 17891
Jun 19 04:40:06 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.66@KRBTEST.COM
I20260619 04:40:06.984858 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:06.969447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42534 (local address 127.9.224.66:36593)
0619 04:40:06.969914 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:06.969919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:06.969936 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:40:06.969994 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:06.969997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:06.970059 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:06.970153 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:06.971464 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.972192 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.973480 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:06.973908 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:06.974042 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:06.978442 (+ 4400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:06.978467 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:06.978484 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:06.978529 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:06.981551 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:06.982478 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:06.982486 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:06.982488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:06.982644 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:06.983076 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:06.983081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:06.983083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:06.983634 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:06.983879 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:06.984274 (+ 395us) server_negotiation.cc:299] Negotiation successful
0619 04:40:06.984516 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":273,"threads_started":1}
I20260619 04:40:06.985491 18022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:07.111467 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 17891
I20260619 04:40:07.134968 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18031
Jun 19 04:40:07 dist-test-slave-9dgf krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.224.67@KRBTEST.COM
I20260619 04:40:07.151803 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:07.135849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46344 (local address 127.9.224.67:33897)
0619 04:40:07.136469 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:07.136474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:07.136492 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:40:07.136560 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:07.136565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:07.136631 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:07.136738 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:07.138105 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:07.138955 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:07.140236 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:07.140687 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:07.140783 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:07.145311 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:07.145329 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:07.145346 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:07.145389 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:07.148766 (+ 3377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:07.149582 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:07.149591 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:07.149594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:07.149795 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:07.150310 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:07.150314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:07.150316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:07.150739 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:07.150984 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:07.151287 (+ 303us) server_negotiation.cc:299] Negotiation successful
0619 04:40:07.151467 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":315,"threads_started":1}
I20260619 04:40:07.152540 18162 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:07.251042 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18031
I20260619 04:40:07.269028 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 17648
I20260619 04:40:07.270383 17720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:07.386193 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 17648
2026-06-19T04:40:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7145 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:40:07 dist-test-slave-9dgf krb5kdc[18291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:40:07 dist-test-slave-9dgf krb5kdc[18291](info): set up 2 sockets
Jun 19 04:40:07 dist-test-slave-9dgf krb5kdc[18291](info): commencing operation
krb5kdc: starting...
W20260619 04:40:08.503465 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:40:08 dist-test-slave-9dgf krb5kdc[18291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:40:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:40:08.734647 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36841
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:09.095041 18304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:09.095326 18304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:09.095492 18304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:09.102766 18304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:09.102869 18304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:09.102965 18304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:09.103076 18304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:09.103158 18304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:09.113267 18304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:09.114629 18304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:09.115984 18304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:09.128109 18312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:09.128227 18309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:09.128206 18310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:09.129222 18304 server_base.cc:1034] running on GCE node
I20260619 04:40:09.130069 18304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:09.131621 18304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:09.132855 18304 hybrid_clock.cc:648] HybridClock initialized: now 1781844009132815 us; error 41 us; skew 500 ppm
I20260619 04:40:09.133213 18304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-06-19T04:40:09Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1810 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:40:09 dist-test-slave-9dgf krb5kdc[18318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:40:09 dist-test-slave-9dgf krb5kdc[18318](info): set up 2 sockets
Jun 19 04:40:09 dist-test-slave-9dgf krb5kdc[18318](info): commencing operation
krb5kdc: starting...
W20260619 04:40:10.312228 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:40:10 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:40:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:40:10.546415 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36197
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:10.900846 18331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:10.901165 18331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:10.901259 18331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:10.910712 18331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:10.910832 18331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:10.910880 18331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:10.910933 18331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:10.910975 18331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:10.921291 18331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:10.922734 18331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:10.924120 18331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:10.936652 18336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:10.936582 18337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:10.936619 18339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:10.937724 18331 server_base.cc:1034] running on GCE node
I20260619 04:40:10.938673 18331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:10.940166 18331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:10.941428 18331 hybrid_clock.cc:648] HybridClock initialized: now 1781844010941369 us; error 56 us; skew 500 ppm
I20260619 04:40:10.941804 18331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:10 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844010, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:10.945086 18331 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:40:10.946750 18331 webserver.cc:460] Webserver started at http://127.9.224.126:46879/ using document root <none> and password file <none>
I20260619 04:40:10.947444 18331 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:10.947541 18331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:10.947795 18331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:10.950951 18331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "f13fa40e9a814ea3a87e83e1a2212385"
format_stamp: "Formatted at 2026-06-19 04:40:10 on dist-test-slave-9dgf"
server_key: "9d3fb065f22a24dd8401817df8953b9b"
server_key_iv: "4aa03326ef26ef445bedb9f85ddf163f"
server_key_version: "encryptionkey@0"
I20260619 04:40:10.951663 18331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "f13fa40e9a814ea3a87e83e1a2212385"
format_stamp: "Formatted at 2026-06-19 04:40:10 on dist-test-slave-9dgf"
server_key: "9d3fb065f22a24dd8401817df8953b9b"
server_key_iv: "4aa03326ef26ef445bedb9f85ddf163f"
server_key_version: "encryptionkey@0"
I20260619 04:40:10.957463 18331 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:40:10.961136 18346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:10.962670 18331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:40:10.962834 18331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "f13fa40e9a814ea3a87e83e1a2212385"
format_stamp: "Formatted at 2026-06-19 04:40:10 on dist-test-slave-9dgf"
server_key: "9d3fb065f22a24dd8401817df8953b9b"
server_key_iv: "4aa03326ef26ef445bedb9f85ddf163f"
server_key_version: "encryptionkey@0"
I20260619 04:40:10.963022 18331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:10.987208 18331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:10.991780 18331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:10.992043 18331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:11.011754 18331 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36197
I20260619 04:40:11.011761 18397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36197 every 8 connection(s)
I20260619 04:40:11.013162 18331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:40:11.017179 18398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:11.020175 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18331
I20260619 04:40:11.020380 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:40:11.021016 10113 external_mini_cluster.cc:1428] Setting key b7159a4fd8000ef7ae2bab57d2bf11b1
I20260619 04:40:11.029515 18398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Bootstrap starting.
I20260619 04:40:11.033007 18398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:11.034145 18398 log.cc:824] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Log is configured to *not* fsync() on all Append() calls
Jun 19 04:40:11 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:11.037150 18398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: No bootstrap required, opened a new log
I20260619 04:40:11.044898 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:11.023235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60916 (local address 127.9.224.126:36197)
0619 04:40:11.024037 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:11.024049 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:11.024090 (+ 41us) server_negotiation.cc:407] Connection header received
0619 04:40:11.025754 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:11.025777 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:11.026203 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:11.026683 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:11.028180 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:11.029484 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:11.030820 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:11.031530 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:11.031738 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:11.036052 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:11.036061 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:11.036078 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:11.036123 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:11.039861 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:11.040714 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:11.040723 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:11.040730 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:11.040931 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:11.041409 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:11.041414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:11.041416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:11.042079 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:11.042504 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:11.043089 (+ 585us) server_negotiation.cc:299] Negotiation successful
0619 04:40:11.043673 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":346,"threads_started":1}
I20260619 04:40:11.045470 18398 raft_consensus.cc:348] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:11.045866 18398 raft_consensus.cc:374] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:11.045979 18398 raft_consensus.cc:729] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13fa40e9a814ea3a87e83e1a2212385, State: Initialized, Role: FOLLOWER
I20260619 04:40:11.046705 18398 consensus_queue.cc:260] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:11.047020 18398 raft_consensus.cc:388] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:40:11.047168 18398 raft_consensus.cc:482] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:40:11.047355 18398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:11.049973 18398 raft_consensus.cc:504] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:11.050545 18398 leader_election.cc:302] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f13fa40e9a814ea3a87e83e1a2212385; no voters:
I20260619 04:40:11.051106 18398 leader_election.cc:288] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:40:11.051322 18403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:11.052022 18403 raft_consensus.cc:686] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 LEADER]: Becoming Leader. State: Replica: f13fa40e9a814ea3a87e83e1a2212385, State: Running, Role: LEADER
I20260619 04:40:11.052580 18403 consensus_queue.cc:237] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:11.053193 18398 sys_catalog.cc:564] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:40:11.055760 18405 sys_catalog.cc:455] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f13fa40e9a814ea3a87e83e1a2212385. Latest consensus state: current_term: 1 leader_uuid: "f13fa40e9a814ea3a87e83e1a2212385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } } }
I20260619 04:40:11.055655 18404 sys_catalog.cc:455] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f13fa40e9a814ea3a87e83e1a2212385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } } }
I20260619 04:40:11.056244 18404 sys_catalog.cc:458] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:11.056252 18405 sys_catalog.cc:458] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:11.057829 18411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:40:11.065301 18411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:40:11.075604 18411 catalog_manager.cc:1347] Generated new cluster ID: 62d240f88ddb437caaaf1a8ab6a834bf
I20260619 04:40:11.075768 18411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:40:11.096282 18411 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:40:11.097937 18411 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:40:11.106211 18411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Generated new TSK 0
I20260619 04:40:11.107164 18411 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:40:11.162676 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36197
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:11.506626 18424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:11.506928 18424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:11.507026 18424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:11.515091 18424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:11.515219 18424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:11.515343 18424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:40:11.525740 18424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:11.527122 18424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:11.528561 18424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:11.542697 18429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:11.542667 18432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:11.543026 18430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:11.543951 18424 server_base.cc:1034] running on GCE node
I20260619 04:40:11.544656 18424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:11.545712 18424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:11.546960 18424 hybrid_clock.cc:648] HybridClock initialized: now 1781844011546881 us; error 69 us; skew 500 ppm
I20260619 04:40:11.547413 18424 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:11 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:11.551087 18424 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:40:11.552749 18424 webserver.cc:460] Webserver started at http://127.9.224.65:42039/ using document root <none> and password file <none>
I20260619 04:40:11.553529 18424 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:11.553659 18424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:11.554000 18424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:11.557225 18424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "b34a82d39208450d86a67580f933351f"
format_stamp: "Formatted at 2026-06-19 04:40:11 on dist-test-slave-9dgf"
server_key: "97a5d4b96b97e6f172174949bc48117b"
server_key_iv: "913e36e0e75e8dea13414b36ad216676"
server_key_version: "encryptionkey@0"
I20260619 04:40:11.558066 18424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "b34a82d39208450d86a67580f933351f"
format_stamp: "Formatted at 2026-06-19 04:40:11 on dist-test-slave-9dgf"
server_key: "97a5d4b96b97e6f172174949bc48117b"
server_key_iv: "913e36e0e75e8dea13414b36ad216676"
server_key_version: "encryptionkey@0"
I20260619 04:40:11.563608 18424 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:40:11.567827 18439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:11.569489 18424 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:40:11.569696 18424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "b34a82d39208450d86a67580f933351f"
format_stamp: "Formatted at 2026-06-19 04:40:11 on dist-test-slave-9dgf"
server_key: "97a5d4b96b97e6f172174949bc48117b"
server_key_iv: "913e36e0e75e8dea13414b36ad216676"
server_key_version: "encryptionkey@0"
I20260619 04:40:11.569906 18424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:11.587487 18424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:11.592393 18424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:11.592768 18424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:11.593940 18424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:11.595602 18424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:11.595690 18424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:11.595883 18424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:11.595950 18424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:11.633126 18424 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:45781
I20260619 04:40:11.633154 18551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:45781 every 8 connection(s)
I20260619 04:40:11.634696 18424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:40:11.636586 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18424
I20260619 04:40:11.637003 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:40:11.637929 10113 external_mini_cluster.cc:1428] Setting key bd8ffe9341bdccdb583d636396623b51
Jun 19 04:40:11 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844011, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:11.656041 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:11.637632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:36977 (local address 127.9.224.126:36197)
0619 04:40:11.638703 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:11.638708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:11.639404 (+ 696us) server_negotiation.cc:407] Connection header received
0619 04:40:11.641262 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:11.641268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:11.641358 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:11.641490 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:11.643162 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:11.643910 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:11.645519 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:11.645929 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:11.646065 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:11.649957 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:11.649962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:11.649965 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:11.650007 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:11.652615 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:11.653531 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:11.653536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:11.653539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:11.653696 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:11.654185 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:11.654190 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:11.654194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:11.654535 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:11.654691 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:11.655436 (+ 745us) server_negotiation.cc:299] Negotiation successful
0619 04:40:11.655665 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":963,"thread_start_us":872,"threads_started":1}
I20260619 04:40:11.657187 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:11.638441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:36977)
0619 04:40:11.639239 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:11.639278 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:11.640971 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:11.641755 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:11.641764 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:11.642356 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:11.642972 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:11.642991 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:11.644074 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:11.644084 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:11.645361 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:11.645374 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:11.646174 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:11.646181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:11.646483 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:11.647232 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:11.647255 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:11.649688 (+ 2433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:11.652778 (+ 3090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:11.652788 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:11.652808 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:11.653365 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:11.653809 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:11.653813 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:11.653817 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:11.654061 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:11.654662 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:11.654690 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:11.655057 (+ 367us) client_negotiation.cc:769] Sending connection context
0619 04:40:11.655339 (+ 282us) client_negotiation.cc:240] Negotiation successful
0619 04:40:11.655891 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":336,"threads_started":1}
I20260619 04:40:11.658829 18552 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36197
I20260619 04:40:11.659204 18552 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:40:11.660108 18552 heartbeater.cc:511] Master 127.9.224.126:36197 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:40:11.662465 18363 ts_manager.cc:194] Registered new tserver with Master: b34a82d39208450d86a67580f933351f (127.9.224.65:45781)
I20260619 04:40:11.663939 18363 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:36977
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:40:11.689280 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36197
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:12.032433 18558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:12.032738 18558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:12.032910 18558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:12.040714 18558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:12.040854 18558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:12.041055 18558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:40:12.051522 18558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:12.052999 18558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:12.054577 18558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:12.068780 18563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:12.068863 18564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:12.068781 18566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:12.069929 18558 server_base.cc:1034] running on GCE node
I20260619 04:40:12.070704 18558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:12.071807 18558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:12.073055 18558 hybrid_clock.cc:648] HybridClock initialized: now 1781844012073005 us; error 45 us; skew 500 ppm
I20260619 04:40:12.073469 18558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:12 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844012, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:12.077000 18558 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:40:12.078676 18558 webserver.cc:460] Webserver started at http://127.9.224.66:42653/ using document root <none> and password file <none>
I20260619 04:40:12.079501 18558 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:12.079654 18558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:12.079984 18558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:12.083266 18558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "5a69c2ec9c724d569400af7ab2265374"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "06d2cf41eae8e634429223114552c973"
server_key_iv: "815233414fd75ab849eaa491981c9fed"
server_key_version: "encryptionkey@0"
I20260619 04:40:12.084139 18558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "5a69c2ec9c724d569400af7ab2265374"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "06d2cf41eae8e634429223114552c973"
server_key_iv: "815233414fd75ab849eaa491981c9fed"
server_key_version: "encryptionkey@0"
I20260619 04:40:12.090781 18558 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260619 04:40:12.094802 18573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:12.096411 18558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:40:12.096642 18558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "5a69c2ec9c724d569400af7ab2265374"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "06d2cf41eae8e634429223114552c973"
server_key_iv: "815233414fd75ab849eaa491981c9fed"
server_key_version: "encryptionkey@0"
I20260619 04:40:12.096889 18558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:12.151292 18558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:12.156595 18558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:12.157033 18558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:12.158352 18558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:12.159907 18558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:12.160024 18558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:12.160207 18558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:12.160287 18558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:12.196692 18558 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:37711
I20260619 04:40:12.196784 18685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:37711 every 8 connection(s)
I20260619 04:40:12.198063 18558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:40:12.204036 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18558
I20260619 04:40:12.204226 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:40:12.204653 10113 external_mini_cluster.cc:1428] Setting key 2cf8e56bc0c2cc1e68b8093b6f78e359
Jun 19 04:40:12 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844012, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:12.222214 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:12.200711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:40851 (local address 127.9.224.126:36197)
0619 04:40:12.201184 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:12.201228 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:12.202489 (+ 1261us) server_negotiation.cc:407] Connection header received
0619 04:40:12.204495 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:12.204501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:12.204603 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:12.204732 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:12.206575 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.207358 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.210279 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.210723 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.210826 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:12.215902 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:12.215908 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:12.215911 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:12.215949 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:12.218856 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:12.219721 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:12.219725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:12.219728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:12.219863 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:12.220360 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:12.220364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:12.220366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:12.220645 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:12.220808 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:12.221573 (+ 765us) server_negotiation.cc:299] Negotiation successful
0619 04:40:12.221823 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":238,"threads_started":1}
I20260619 04:40:12.223323 18689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:12.201419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:40851)
0619 04:40:12.202324 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:12.202364 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:12.204104 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:12.204980 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:12.204989 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:12.205642 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:12.206378 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:12.206414 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.207545 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.207552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:12.210015 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:12.210037 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.210992 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.211002 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:12.211388 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:12.212260 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:12.212300 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:12.215557 (+ 3257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:12.219035 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:12.219046 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:12.219068 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:12.219559 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:12.219984 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:12.219989 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:12.219993 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:12.220223 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:12.220781 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:12.220791 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:12.221177 (+ 386us) client_negotiation.cc:769] Sending connection context
0619 04:40:12.221474 (+ 297us) client_negotiation.cc:240] Negotiation successful
0619 04:40:12.222068 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":359,"threads_started":1}
I20260619 04:40:12.225018 18686 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36197
I20260619 04:40:12.225378 18686 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:12.226357 18686 heartbeater.cc:511] Master 127.9.224.126:36197 requested a full tablet report, sending...
I20260619 04:40:12.227972 18363 ts_manager.cc:194] Registered new tserver with Master: 5a69c2ec9c724d569400af7ab2265374 (127.9.224.66:37711)
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
I20260619 04:40:12.228863 18363 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:40851
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:40:12.258324 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36197
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:12.600222 18692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:12.600692 18692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:12.600797 18692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:12.608827 18692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:12.608964 18692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:12.609088 18692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:40:12.619336 18692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:12.620611 18692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:12.621985 18692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:12.635303 18697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:12.635656 18700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:12.635339 18698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:12.636669 18692 server_base.cc:1034] running on GCE node
I20260619 04:40:12.637387 18692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:12.638583 18692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:12.639818 18692 hybrid_clock.cc:648] HybridClock initialized: now 1781844012639760 us; error 76 us; skew 500 ppm
I20260619 04:40:12.640097 18692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:12 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844012, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:12.643225 18692 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:40:12.644760 18692 webserver.cc:460] Webserver started at http://127.9.224.67:34399/ using document root <none> and password file <none>
I20260619 04:40:12.645488 18692 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:12.645591 18692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:12.645931 18692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:12.648945 18692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "b29cbc6b8eb64deab9dca9fd67cc8ec8"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "fa17b11ad4da299f0309090221a12376"
server_key_iv: "2e9e0b4d11648a2ebb99903392708060"
server_key_version: "encryptionkey@0"
I20260619 04:40:12.649747 18692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "b29cbc6b8eb64deab9dca9fd67cc8ec8"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "fa17b11ad4da299f0309090221a12376"
server_key_iv: "2e9e0b4d11648a2ebb99903392708060"
server_key_version: "encryptionkey@0"
I20260619 04:40:12.655494 18692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260619 04:40:12.659274 18707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:12.660817 18692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:40:12.661098 18692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "b29cbc6b8eb64deab9dca9fd67cc8ec8"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "fa17b11ad4da299f0309090221a12376"
server_key_iv: "2e9e0b4d11648a2ebb99903392708060"
server_key_version: "encryptionkey@0"
I20260619 04:40:12.661356 18692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:12.667426 18552 heartbeater.cc:503] Master 127.9.224.126:36197 was elected leader, sending a full tablet report...
I20260619 04:40:12.714085 18692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:12.718747 18692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:12.718999 18692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:12.719969 18692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:12.721313 18692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:12.721388 18692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:12.721475 18692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:12.721518 18692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:12.762742 18692 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:39185
I20260619 04:40:12.762853 18819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:39185 every 8 connection(s)
I20260619 04:40:12.764099 18692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:40:12.773871 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18692
I20260619 04:40:12.774085 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:40:12.774627 10113 external_mini_cluster.cc:1428] Setting key d03d9b30fef003b5292323280b8b095c
Jun 19 04:40:12 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844012, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:12.786044 18822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:12.766992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:55713 (local address 127.9.224.126:36197)
0619 04:40:12.767473 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:12.767477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:12.768725 (+ 1248us) server_negotiation.cc:407] Connection header received
0619 04:40:12.770664 (+ 1939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:12.770670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:12.770782 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:12.770907 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:12.772528 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.773446 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.775583 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.776148 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.776290 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:12.780176 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:12.780181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:12.780184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:12.780219 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:12.782913 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:12.783667 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:12.783672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:12.783675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:12.783791 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:12.784239 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:12.784244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:12.784247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:12.784554 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:12.784720 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:12.785445 (+ 725us) server_negotiation.cc:299] Negotiation successful
0619 04:40:12.785668 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":265,"threads_started":1}
I20260619 04:40:12.787123 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:12.767789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:55713)
0619 04:40:12.768535 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:12.768576 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:12.770350 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:12.771186 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:12.771196 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:12.771751 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:12.772343 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:12.772361 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.773663 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.773668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:12.775373 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:12.775413 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.776389 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.776396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:12.776664 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:12.777411 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:12.777436 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:12.779959 (+ 2523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:12.783056 (+ 3097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:12.783066 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:12.783091 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:12.783519 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:12.783904 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:12.783910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:12.783913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:12.784109 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:12.784707 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:12.784715 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:12.785067 (+ 352us) client_negotiation.cc:769] Sending connection context
0619 04:40:12.785344 (+ 277us) client_negotiation.cc:240] Negotiation successful
0619 04:40:12.785892 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":289,"threads_started":1}
I20260619 04:40:12.788944 18820 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36197
I20260619 04:40:12.789324 18820 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:12.790205 18820 heartbeater.cc:511] Master 127.9.224.126:36197 requested a full tablet report, sending...
I20260619 04:40:12.791728 18363 ts_manager.cc:194] Registered new tserver with Master: b29cbc6b8eb64deab9dca9fd67cc8ec8 (127.9.224.67:39185)
I20260619 04:40:12.792479 18363 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:55713
I20260619 04:40:12.803313 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab.
Entry for principal oryx/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab.
WARNING: no policy specified for oryx/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab.
Entry for principal oryx/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab.
WARNING: no policy specified for oryx/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab.
Entry for principal oryx/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab.
I20260619 04:40:12.947446 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18424
Jun 19 04:40:12 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:40:12.965044 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:12.948823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43306 (local address 127.9.224.65:45781)
0619 04:40:12.949508 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:12.949515 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:12.949542 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:40:12.949603 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:12.949610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:12.949848 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:12.950044 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:12.951466 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.952474 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.953820 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:12.954492 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:12.954645 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:12.959158 (+ 4513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:12.959175 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:12.959192 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:12.959233 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:12.962198 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:12.963015 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:12.963023 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:12.963027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:12.963182 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:12.963563 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:12.963567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:12.963570 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:12.963963 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:12.964237 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:12.964464 (+ 227us) server_negotiation.cc:299] Negotiation successful
0619 04:40:12.964722 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":347,"threads_started":1}
I20260619 04:40:12.966764 18547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:13.050695 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18424
I20260619 04:40:13.068516 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18558
Jun 19 04:40:13 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:40:13.085565 18833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:13.069580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44836 (local address 127.9.224.66:37711)
0619 04:40:13.070081 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:13.070089 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:13.070113 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:40:13.070172 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:13.070179 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:13.070449 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:13.070620 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:13.071855 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:13.072845 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:13.074097 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:13.074712 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:13.074850 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:13.079356 (+ 4506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:13.079370 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:13.079386 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:13.079461 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:13.082557 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:13.083411 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:13.083419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:13.083425 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:13.083568 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:13.083948 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:13.083952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:13.083954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:13.084354 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:13.084588 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:13.085003 (+ 415us) server_negotiation.cc:299] Negotiation successful
0619 04:40:13.085265 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":243,"threads_started":1}
I20260619 04:40:13.087164 18681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:13.171772 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18558
I20260619 04:40:13.188156 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18692
Jun 19 04:40:13 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:40:13.205124 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:13.189214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40920 (local address 127.9.224.67:39185)
0619 04:40:13.189701 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:13.189708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:13.189737 (+ 29us) server_negotiation.cc:407] Connection header received
0619 04:40:13.189799 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:13.189805 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:13.190007 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:13.190190 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:13.191504 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:13.192474 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:13.193688 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:13.194403 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:13.194504 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:13.198848 (+ 4344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:13.198861 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:13.198878 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:13.198913 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:13.202084 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:13.202868 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:13.202875 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:13.202877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:13.203000 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:13.203544 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:13.203548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:13.203551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:13.203941 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:13.204189 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:13.204475 (+ 286us) server_negotiation.cc:299] Negotiation successful
0619 04:40:13.204713 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":215,"threads_started":1}
I20260619 04:40:13.206698 18815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:13.290196 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18692
I20260619 04:40:13.306406 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18331
I20260619 04:40:13.307621 18393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:13.411585 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18331
I20260619 04:40:13.432322 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36197
--webserver_interface=127.9.224.126
--webserver_port=46879
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:13.766026 18838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:13.766458 18838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:13.766644 18838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:13.774698 18838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:13.774814 18838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:13.774899 18838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:13.774981 18838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:13.775029 18838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:13.785660 18838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=46879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:13.787140 18838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:13.788493 18838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:13.801172 18843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:13.801142 18846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:13.801198 18844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:13.801638 18838 server_base.cc:1034] running on GCE node
I20260619 04:40:13.802812 18838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:13.804302 18838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:13.805557 18838 hybrid_clock.cc:648] HybridClock initialized: now 1781844013805483 us; error 65 us; skew 500 ppm
I20260619 04:40:13.805914 18838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:13 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844013, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:13.809377 18838 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:40:13.811127 18838 webserver.cc:460] Webserver started at http://127.9.224.126:46879/ using document root <none> and password file <none>
I20260619 04:40:13.811896 18838 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:13.812162 18838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:13.818066 18838 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 04:40:13.821229 18853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:13.822904 18838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:40:13.823150 18838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "f13fa40e9a814ea3a87e83e1a2212385"
format_stamp: "Formatted at 2026-06-19 04:40:10 on dist-test-slave-9dgf"
server_key: "9d3fb065f22a24dd8401817df8953b9b"
server_key_iv: "4aa03326ef26ef445bedb9f85ddf163f"
server_key_version: "encryptionkey@0"
I20260619 04:40:13.824221 18838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:13.843267 18838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:13.848102 18838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:13.848394 18838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:13.868368 18838 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36197
I20260619 04:40:13.868374 18904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36197 every 8 connection(s)
I20260619 04:40:13.870024 18838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:40:13.875767 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18838
I20260619 04:40:13.876619 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:45781
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:36197
--webserver_port=42039
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:40:13.877521 18905 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:40:13.880967 18905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Bootstrap starting.
I20260619 04:40:13.900424 18905 log.cc:824] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:13.909942 18905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:40:13.910590 18905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Bootstrap complete.
I20260619 04:40:13.921748 18905 raft_consensus.cc:348] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:13.922737 18905 raft_consensus.cc:729] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13fa40e9a814ea3a87e83e1a2212385, State: Initialized, Role: FOLLOWER
I20260619 04:40:13.923506 18905 consensus_queue.cc:260] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:13.923745 18905 raft_consensus.cc:388] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:40:13.923861 18905 raft_consensus.cc:482] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:40:13.924068 18905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 1 FOLLOWER]: Advancing to term 2
I20260619 04:40:13.928159 18905 raft_consensus.cc:504] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:13.928700 18905 leader_election.cc:302] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f13fa40e9a814ea3a87e83e1a2212385; no voters:
I20260619 04:40:13.929354 18905 leader_election.cc:288] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 04:40:13.929606 18909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 04:40:13.930856 18909 raft_consensus.cc:686] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [term 2 LEADER]: Becoming Leader. State: Replica: f13fa40e9a814ea3a87e83e1a2212385, State: Running, Role: LEADER
I20260619 04:40:13.931526 18905 sys_catalog.cc:564] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:40:13.931555 18909 consensus_queue.cc:237] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } }
I20260619 04:40:13.937742 18910 sys_catalog.cc:455] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f13fa40e9a814ea3a87e83e1a2212385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } } }
I20260619 04:40:13.938179 18910 sys_catalog.cc:458] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:13.938768 18911 sys_catalog.cc:455] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f13fa40e9a814ea3a87e83e1a2212385. Latest consensus state: current_term: 2 leader_uuid: "f13fa40e9a814ea3a87e83e1a2212385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13fa40e9a814ea3a87e83e1a2212385" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36197 } } }
I20260619 04:40:13.939071 18911 sys_catalog.cc:458] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:13.944450 18919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:40:13.950574 18919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:40:13.952142 18919 catalog_manager.cc:1259] Loaded cluster ID: 62d240f88ddb437caaaf1a8ab6a834bf
I20260619 04:40:13.952328 18919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:40:13.956423 18919 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:40:13.958077 18919 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f13fa40e9a814ea3a87e83e1a2212385: Loaded TSK: 0
I20260619 04:40:13.959756 18919 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 04:40:14.232757 18907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:14.233114 18907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:14.233281 18907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:14.241006 18907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:14.241189 18907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:14.241381 18907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:40:14.251745 18907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.65.keytab
--principal=oryx/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:45781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=42039
--tserver_master_addrs=127.9.224.126:36197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:14.253119 18907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:14.254536 18907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:14.268040 18932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:14.268072 18933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:14.269423 18935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:14.272105 18907 server_base.cc:1034] running on GCE node
I20260619 04:40:14.272871 18907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:14.274060 18907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:14.275302 18907 hybrid_clock.cc:648] HybridClock initialized: now 1781844014275226 us; error 98 us; skew 500 ppm
I20260619 04:40:14.275728 18907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:14 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844014, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:14.279338 18907 init.cc:377] Logged in from keytab as oryx/127.9.224.65@KRBTEST.COM (short username oryx)
I20260619 04:40:14.281193 18907 webserver.cc:460] Webserver started at http://127.9.224.65:42039/ using document root <none> and password file <none>
I20260619 04:40:14.282011 18907 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:14.282171 18907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:14.288206 18907 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 04:40:14.291388 18942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:14.293061 18907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:40:14.293246 18907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "b34a82d39208450d86a67580f933351f"
format_stamp: "Formatted at 2026-06-19 04:40:11 on dist-test-slave-9dgf"
server_key: "97a5d4b96b97e6f172174949bc48117b"
server_key_iv: "913e36e0e75e8dea13414b36ad216676"
server_key_version: "encryptionkey@0"
I20260619 04:40:14.294296 18907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:14.317478 18907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:14.322329 18907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:14.322634 18907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:14.323724 18907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:14.325133 18907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:14.325220 18907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:14.325367 18907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:14.325445 18907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:14.358866 18907 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:45781
I20260619 04:40:14.358920 19054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:45781 every 8 connection(s)
I20260619 04:40:14.360391 18907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:40:14.370626 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 18907
I20260619 04:40:14.371420 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:37711
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:36197
--webserver_port=42653
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:40:14 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:14 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 04:40:14.712373 19059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:14.712672 19059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:14.712823 19059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:14.720528 19059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:14.720640 19059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:14.720809 19059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:40:14.731182 19059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.66.keytab
--principal=oryx/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:37711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=42653
--tserver_master_addrs=127.9.224.126:36197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:14.732770 19059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:14.734203 19059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:14.754904 19065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:14.756731 19066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:14.757089 19068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:14.758088 19059 server_base.cc:1034] running on GCE node
I20260619 04:40:14.759389 19059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:14.761509 19059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:14.762912 19059 hybrid_clock.cc:648] HybridClock initialized: now 1781844014762805 us; error 77 us; skew 500 ppm
I20260619 04:40:14.763592 19059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:14 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844014, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:14.769326 19059 init.cc:377] Logged in from keytab as oryx/127.9.224.66@KRBTEST.COM (short username oryx)
I20260619 04:40:14.771486 19059 webserver.cc:460] Webserver started at http://127.9.224.66:42653/ using document root <none> and password file <none>
I20260619 04:40:14.772308 19059 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:14.772461 19059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:14.779068 19059 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 04:40:14.782692 19075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:14.784708 19059 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260619 04:40:14.784904 19059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "5a69c2ec9c724d569400af7ab2265374"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "06d2cf41eae8e634429223114552c973"
server_key_iv: "815233414fd75ab849eaa491981c9fed"
server_key_version: "encryptionkey@0"
I20260619 04:40:14.785959 19059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:14.804534 19059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:14.809013 19059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:14.809295 19059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:14.810434 19059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:14.811947 19059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:14.812088 19059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:14.812242 19059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:14.812362 19059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:14.860049 19059 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:37711
I20260619 04:40:14.860103 19187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:37711 every 8 connection(s)
I20260619 04:40:14.861567 19059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:40:14.866644 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19059
I20260619 04:40:14.867393 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:39185
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:36197
--webserver_port=34399
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:40:14 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:14 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 04:40:15.219919 19192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:15.220278 19192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:15.220459 19192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:15.228036 19192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:15.228189 19192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:15.228377 19192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:40:15.238945 19192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/krb5kdc/oryx_127.9.224.67.keytab
--principal=oryx/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:39185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=34399
--tserver_master_addrs=127.9.224.126:36197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:15.240448 19192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:15.241874 19192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:15.260252 19199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:15.260241 19198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:15.272529 19201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:15.276155 19192 server_base.cc:1034] running on GCE node
I20260619 04:40:15.276887 19192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:15.278067 19192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:15.279302 19192 hybrid_clock.cc:648] HybridClock initialized: now 1781844015279229 us; error 68 us; skew 500 ppm
I20260619 04:40:15.279702 19192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844015, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:15.284135 19192 init.cc:377] Logged in from keytab as oryx/127.9.224.67@KRBTEST.COM (short username oryx)
I20260619 04:40:15.287593 19192 webserver.cc:460] Webserver started at http://127.9.224.67:34399/ using document root <none> and password file <none>
I20260619 04:40:15.289090 19192 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:15.289321 19192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:15.301635 19192 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.008s sys 0.000s
I20260619 04:40:15.307301 19208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:15.310178 19192 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260619 04:40:15.310518 19192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "b29cbc6b8eb64deab9dca9fd67cc8ec8"
format_stamp: "Formatted at 2026-06-19 04:40:12 on dist-test-slave-9dgf"
server_key: "fa17b11ad4da299f0309090221a12376"
server_key_iv: "2e9e0b4d11648a2ebb99903392708060"
server_key_version: "encryptionkey@0"
I20260619 04:40:15.312656 19192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:15.355041 19192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:15.363749 19192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:15.364210 19192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:15.375557 19192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:15.379046 19192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:15.379271 19192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:15.379454 19192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:15.379572 19192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:15.446764 19192 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:39185
I20260619 04:40:15.446857 19320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:39185 every 8 connection(s)
I20260619 04:40:15.449586 19192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:40:15.456389 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19192
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:15.515236 19323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:15.457691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45064 (local address 127.9.224.126:36197)
0619 04:40:15.479551 (+ 21860us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:15.479561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:15.479587 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:40:15.479657 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:15.479665 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:15.479777 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:15.483069 (+ 3292us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:15.483464 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.485268 (+ 1804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.493453 (+ 8185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.494505 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.494721 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.500221 (+ 5500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:15.500239 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:15.500278 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:15.500366 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:15.506447 (+ 6081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:15.507910 (+ 1463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:15.507926 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:15.507943 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:15.508282 (+ 339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:15.508903 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:15.508912 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:15.508918 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:15.509941 (+ 1023us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:15.512346 (+ 2405us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:15.512801 (+ 455us) server_negotiation.cc:299] Negotiation successful
0619 04:40:15.513592 (+ 791us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21636,"thread_start_us":14352,"threads_started":1}
W20260619 04:40:15.835557 19058 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.459s user 0.000s sys 0.014s
W20260619 04:40:15.837872 19057 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:14.363689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:37967 (local address 127.9.224.126:36197)
0619 04:40:14.364457 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:14.364475 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:14.364993 (+ 518us) server_negotiation.cc:407] Connection header received
0619 04:40:14.367205 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:14.367217 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:14.367577 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:14.367966 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:14.369811 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.371912 (+ 2101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.373666 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.374878 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.375099 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.837367 (+1462268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:37967: BlockingRecv error: recv got EOF from 127.9.224.65:37967 (error 108)
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":326,"threads_started":1}
I20260619 04:40:15.840413 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:14.363808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:37967)
0619 04:40:14.364800 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:14.364847 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:14.366629 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:14.368089 (+ 1460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:14.368101 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:14.368947 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:14.369603 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:14.369622 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.372125 (+ 2503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.372129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:14.373484 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:14.373499 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.375130 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.375135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:14.375351 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:14.376209 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:14.376233 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:15.838659 (+1462426us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":535,"threads_started":1}
W20260619 04:40:15.841914 19055 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36197 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.224.126:36197: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 04:40:15.866492 19057 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:15.843252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:58485 (local address 127.9.224.126:36197)
0619 04:40:15.843532 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:15.843543 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:15.843903 (+ 360us) server_negotiation.cc:407] Connection header received
0619 04:40:15.844158 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:15.844166 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:15.844289 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:15.844450 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:15.845814 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.847587 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.850945 (+ 3358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.852082 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.852260 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.866046 (+ 13786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:58485: BlockingRecv error: recv got EOF from 127.9.224.65:58485 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260619 04:40:15.867676 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:15.843057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:58485)
0619 04:40:15.843758 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:15.843788 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:15.843988 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:15.844567 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:15.844576 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:15.845278 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:15.845601 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:15.845617 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.847812 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.847830 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:15.850659 (+ 2829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:15.850690 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.852724 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.852735 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:15.853045 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.858301 (+ 5256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:15.858342 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:15.867226 (+ 8884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":522}
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:15 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:15.896450 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:15.868925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:38803)
0619 04:40:15.876626 (+ 7701us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:15.876664 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:15.876985 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:15.877824 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:15.877832 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:15.878572 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:15.878904 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:15.878922 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.881421 (+ 2499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.881430 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:15.885064 (+ 3634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:15.885089 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.888167 (+ 3078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.888177 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:15.888507 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.889620 (+ 1113us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:15.889658 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:15.895997 (+ 6339us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":7441}
W20260619 04:40:15.897289 19055 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 04:40:15.897424 19057 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:15.869410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:38803 (local address 127.9.224.126:36197)
0619 04:40:15.869666 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:15.869677 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:15.876820 (+ 7143us) server_negotiation.cc:407] Connection header received
0619 04:40:15.877203 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:15.877213 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:15.877366 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:15.877482 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:15.879211 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.881043 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.886414 (+ 5371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.887598 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.887762 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.896963 (+ 9201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:38803: BlockingRecv error: recv got EOF from 127.9.224.65:38803 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260619 04:40:16.215847 19191 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.336s user 0.004s sys 0.014s
W20260619 04:40:16.217185 19190 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:14.864767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:57621 (local address 127.9.224.126:36197)
0619 04:40:14.865249 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:14.865253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:14.867929 (+ 2676us) server_negotiation.cc:407] Connection header received
0619 04:40:14.870290 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:14.870298 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:14.870398 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:14.870514 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:14.873019 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.874377 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.877113 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.877964 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.878107 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.216868 (+1338761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:57621: BlockingRecv error: recv got EOF from 127.9.224.66:57621 (error 108)
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":259,"threads_started":1}
I20260619 04:40:16.217751 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:14.865847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:57621)
0619 04:40:14.866949 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:14.867003 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:14.869818 (+ 2815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:14.871031 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:14.871045 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:14.871885 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:14.872758 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:14.872789 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.874591 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.874599 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:14.876913 (+ 2314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:14.876932 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:14.878484 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:14.878493 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:14.878865 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:14.879951 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:14.879989 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.216671 (+1336682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":498,"threads_started":1}
W20260619 04:40:16.218981 19188 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36197 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.224.126:36197: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:16.229468 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:16.219892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:46689)
0619 04:40:16.220230 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:16.220250 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:16.220421 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:16.220818 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:16.220823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:16.221281 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:16.221483 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.221496 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.222636 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.222641 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.223572 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.223582 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.224261 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.224267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.224435 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.225166 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:16.225184 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.229170 (+ 3986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218}
W20260619 04:40:16.229589 19190 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:16.219929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:46689 (local address 127.9.224.126:36197)
0619 04:40:16.220097 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:16.220101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:16.220316 (+ 215us) server_negotiation.cc:407] Connection header received
0619 04:40:16.220551 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:16.220556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:16.220642 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:16.220755 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:16.221599 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.222499 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.223707 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.224095 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.224232 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.229359 (+ 5127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:46689: BlockingRecv error: recv got EOF from 127.9.224.66:46689 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:16.241677 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:16.230164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:42267)
0619 04:40:16.230441 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:16.230470 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:16.230621 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:16.231046 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:16.231054 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:16.231755 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:16.232135 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.232153 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.234367 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.234371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.235453 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.235465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.236734 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.236738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.236868 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.237631 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:16.237648 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.241477 (+ 3829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260619 04:40:16.242013 19188 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 04:40:16.242341 19190 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:16.230357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:42267 (local address 127.9.224.126:36197)
0619 04:40:16.230515 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:16.230519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:16.230534 (+ 15us) server_negotiation.cc:407] Connection header received
0619 04:40:16.230762 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:16.230765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:16.230830 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:16.230926 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:16.232401 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.234183 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.235600 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.236565 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.236745 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.241876 (+ 5131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:42267: BlockingRecv error: recv got EOF from 127.9.224.66:42267 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260619 04:40:16.676424 19324 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.182s user 0.004s sys 0.021s
W20260619 04:40:16.677541 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:15.454110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:45769 (local address 127.9.224.126:36197)
0619 04:40:15.472365 (+ 18255us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:15.472376 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:15.472419 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:40:15.472516 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:15.472525 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:15.472642 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:15.472803 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:15.476791 (+ 3988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.478813 (+ 2022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.490464 (+ 11651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.491500 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.491660 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.677342 (+1185682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:45769: BlockingRecv error: recv got EOF from 127.9.224.67:45769 (error 108)
Metrics: {"server-negotiator.queue_time_us":18064,"thread_start_us":25015,"threads_started":1}
I20260619 04:40:16.678102 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:15.455222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:45769)
0619 04:40:15.466924 (+ 11702us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:15.466983 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:15.470378 (+ 3395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:15.473689 (+ 3311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:15.473711 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:15.475094 (+ 1383us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:15.476403 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:15.476447 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.485623 (+ 9176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.485634 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:15.489083 (+ 3449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:15.489114 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:15.492223 (+ 3109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:15.492234 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:15.492774 (+ 540us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:15.494573 (+ 1799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:15.494624 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.677163 (+1182539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":11337,"thread_start_us":11036,"threads_started":1}
W20260619 04:40:16.679000 19321 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36197 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.224.126:36197: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:16.689250 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:16.679688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:54025)
0619 04:40:16.679909 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:16.679931 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:16.680085 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:16.680421 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:16.680426 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:16.680817 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:16.680985 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.680993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.681981 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.681987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.683013 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.683025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.683804 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.683810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.683976 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.684647 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:16.684666 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.689006 (+ 4340us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260619 04:40:16.689556 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:16.679766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:54025 (local address 127.9.224.126:36197)
0619 04:40:16.679935 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:16.679941 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:16.680012 (+ 71us) server_negotiation.cc:407] Connection header received
0619 04:40:16.680224 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:16.680228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:16.680287 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:16.680393 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:16.681122 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.681847 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.683152 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.683621 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.683760 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.689313 (+ 5553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:54025: BlockingRecv error: recv got EOF from 127.9.224.67:54025 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:16.699493 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:16.690033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:57345)
0619 04:40:16.690196 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:16.690266 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:16.690364 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:16.690873 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:16.690880 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:16.691197 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:16.691402 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.691412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.692514 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.692518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.693523 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.693536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.694393 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.694397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.694541 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.695180 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:16.695223 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.699037 (+ 3814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260619 04:40:16.699709 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:16.690295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:57345 (local address 127.9.224.126:36197)
0619 04:40:16.690520 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:16.690524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:16.690539 (+ 15us) server_negotiation.cc:407] Connection header received
0619 04:40:16.690581 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:16.690585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:16.690652 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:16.690767 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:16.691553 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.692360 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.693702 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.694168 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.694360 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.699353 (+ 4993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:57345: BlockingRecv error: recv got EOF from 127.9.224.67:57345 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
W20260619 04:40:16.700032 19321 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:16 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:16.907565 19328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:16.897920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:54039)
0619 04:40:16.898504 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:16.898526 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:16.898723 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:16.899110 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:16.899116 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:16.899646 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:16.899800 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.899809 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.901057 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.901064 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.902269 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:16.902282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.903010 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.903018 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:16.903192 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.903821 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:16.903838 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:16.907328 (+ 3490us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":334,"threads_started":1}
W20260619 04:40:16.907765 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:16.898068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:54039 (local address 127.9.224.126:36197)
0619 04:40:16.898276 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:16.898285 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:16.898618 (+ 333us) server_negotiation.cc:407] Connection header received
0619 04:40:16.898872 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:16.898884 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:16.898967 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:16.899074 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:16.899958 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.900908 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.902415 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:16.902833 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:16.902975 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:16.907528 (+ 4553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:54039: BlockingRecv error: recv got EOF from 127.9.224.65:54039 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 04:40:17 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:17 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:17.252585 19329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:17.242652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:60883)
0619 04:40:17.243198 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:17.243213 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:17.243377 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:17.243727 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:17.243732 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:17.244259 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:17.244405 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:17.244414 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.245470 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.245476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:17.246462 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:17.246473 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.247240 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.247247 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:17.247416 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:17.248054 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:17.248071 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:17.252351 (+ 4280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":292,"threads_started":1}
W20260619 04:40:17.252835 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:17.242830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:60883 (local address 127.9.224.126:36197)
0619 04:40:17.243057 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:17.243064 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:17.243305 (+ 241us) server_negotiation.cc:407] Connection header received
0619 04:40:17.243512 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:17.243518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:17.243589 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:17.243695 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:17.244550 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.245318 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.246608 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.247049 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.247179 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:17.252562 (+ 5383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:60883: BlockingRecv error: recv got EOF from 127.9.224.66:60883 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Jun 19 04:40:17 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:17 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:17.710754 19330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:17.700775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:48907)
0619 04:40:17.701383 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:17.701400 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:17.701559 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:17.701985 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:17.701989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:17.702653 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:17.702852 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:17.702867 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.703977 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.703981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:17.704924 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:17.704937 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.705794 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.705799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:17.705926 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:17.706648 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:17.706667 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:17.710502 (+ 3835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":357,"threads_started":1}
W20260619 04:40:17.710986 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:17.700871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:48907 (local address 127.9.224.126:36197)
0619 04:40:17.701054 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:17.701060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:17.701492 (+ 432us) server_negotiation.cc:407] Connection header received
0619 04:40:17.701701 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:17.701706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:17.701806 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:17.701916 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:17.703020 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.703845 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.705077 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.705552 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.705658 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:17.710770 (+ 5112us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:48907: BlockingRecv error: recv got EOF from 127.9.224.67:48907 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Jun 19 04:40:17 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:17 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:17.918376 19331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:17.908714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:49155)
0619 04:40:17.909290 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:17.909317 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:17.909446 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:17.909790 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:17.909793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:17.910186 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:17.910388 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:17.910396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.911465 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.911468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:17.912587 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:17.912602 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.913556 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.913563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:17.913780 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:17.914440 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:17.914480 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:17.918043 (+ 3563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":366,"threads_started":1}
W20260619 04:40:17.918638 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:17.908810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:49155 (local address 127.9.224.126:36197)
0619 04:40:17.909134 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:17.909149 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:17.909413 (+ 264us) server_negotiation.cc:407] Connection header received
0619 04:40:17.909554 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:17.909558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:17.909623 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:17.909722 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:17.910545 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.911337 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.912775 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:17.913371 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:17.913492 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:17.918392 (+ 4900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:49155: BlockingRecv error: recv got EOF from 127.9.224.65:49155 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Jun 19 04:40:18 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:18 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:18.263098 19332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:18.253551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:51775)
0619 04:40:18.254035 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:18.254050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:18.254247 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:18.254586 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:18.254591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:18.255030 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:18.255215 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:18.255224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.256501 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.256506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:18.257781 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:18.257794 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.258518 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.258522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:18.258653 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:18.259212 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:18.259231 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:18.262817 (+ 3586us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":276,"threads_started":1}
W20260619 04:40:18.263173 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:18.253629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:51775 (local address 127.9.224.126:36197)
0619 04:40:18.253876 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:18.253885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:18.254139 (+ 254us) server_negotiation.cc:407] Connection header received
0619 04:40:18.254378 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:18.254384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:18.254460 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:18.254565 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:18.255355 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.256356 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.257907 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.258383 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.258481 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:18.262981 (+ 4500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:51775: BlockingRecv error: recv got EOF from 127.9.224.66:51775 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Jun 19 04:40:18 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:18 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:18.721222 19333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:18.711752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:51371)
0619 04:40:18.712329 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:18.712348 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:18.712471 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:18.712835 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:18.712839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:18.713252 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:18.713431 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:18.713442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.714570 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.714574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:18.715535 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:18.715548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.716275 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.716280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:18.716404 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:18.717053 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:18.717073 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:18.720901 (+ 3828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":358,"threads_started":1}
W20260619 04:40:18.721829 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:18.711910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:51371 (local address 127.9.224.126:36197)
0619 04:40:18.712078 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:18.712082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:18.712461 (+ 379us) server_negotiation.cc:407] Connection header received
0619 04:40:18.712580 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:18.712583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:18.712647 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:18.712733 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:18.713583 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.714438 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.715696 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.716122 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.716227 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:18.721194 (+ 4967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:51371: BlockingRecv error: recv got EOF from 127.9.224.67:51371 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Jun 19 04:40:18 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:18 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:18.928390 19334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:18.919334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:46611)
0619 04:40:18.919846 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:18.919867 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:18.919981 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:18.920359 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:18.920363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:18.920708 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:18.920872 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:18.920880 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.921940 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.921952 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:18.922933 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:18.922945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.923690 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.923696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:18.923870 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:18.924509 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:18.924528 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:18.928014 (+ 3486us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":270,"threads_started":1}
W20260619 04:40:18.928742 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:18.919379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:46611 (local address 127.9.224.126:36197)
0619 04:40:18.919634 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:18.919639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:18.919965 (+ 326us) server_negotiation.cc:407] Connection header received
0619 04:40:18.920074 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:18.920078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:18.920141 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:18.920291 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:18.921021 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.921791 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.923079 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:18.923530 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:18.923675 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:18.928252 (+ 4577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:46611: BlockingRecv error: recv got EOF from 127.9.224.65:46611 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
Jun 19 04:40:19 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:19 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:19.273227 19335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:19.263993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:41771)
0619 04:40:19.264724 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:19.264740 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:19.264896 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:19.265248 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:19.265252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:19.265638 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:19.265814 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:19.265823 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.266891 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.266902 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:19.267814 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:19.267824 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.268520 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.268526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:19.268710 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:19.269338 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:19.269355 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:19.272865 (+ 3510us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":425,"threads_started":1}
W20260619 04:40:19.273336 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:19.264118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:41771 (local address 127.9.224.126:36197)
0619 04:40:19.264471 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:19.264480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:19.264824 (+ 344us) server_negotiation.cc:407] Connection header received
0619 04:40:19.265047 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:19.265051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:19.265111 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:19.265213 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:19.265958 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.266756 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.267953 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.268376 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.268516 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:19.273089 (+ 4573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:41771: BlockingRecv error: recv got EOF from 127.9.224.66:41771 (error 108)
Metrics: {"server-negotiator.queue_time_us":194}
Jun 19 04:40:19 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:19 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:19.731323 19336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:19.722252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:43943)
0619 04:40:19.722841 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:19.722863 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:19.722980 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:19.723355 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:19.723358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:19.723752 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:19.723914 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:19.723924 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.725022 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.725027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:19.725910 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:19.725921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.726755 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.726759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:19.726879 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:19.727449 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:19.727467 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:19.731092 (+ 3625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":335,"threads_started":1}
W20260619 04:40:19.731647 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:19.722345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:43943 (local address 127.9.224.126:36197)
0619 04:40:19.722512 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:19.722516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:19.722943 (+ 427us) server_negotiation.cc:407] Connection header received
0619 04:40:19.723134 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:19.723138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:19.723203 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:19.723314 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:19.724071 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.724878 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.726056 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.726607 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.726711 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:19.731334 (+ 4623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:43943: BlockingRecv error: recv got EOF from 127.9.224.67:43943 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 04:40:19 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:19 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:19.939472 19337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:19.929553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:48105)
0619 04:40:19.930080 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:19.930101 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:19.930265 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:19.930617 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:19.930620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:19.931003 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:19.931163 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:19.931171 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.932306 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.932311 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:19.933408 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:19.933420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.934207 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.934213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:19.934482 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:19.935207 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:19.935226 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:19.939158 (+ 3932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":304,"threads_started":1}
W20260619 04:40:19.939682 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:19.929543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:48105 (local address 127.9.224.126:36197)
0619 04:40:19.929742 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:19.929748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:19.930192 (+ 444us) server_negotiation.cc:407] Connection header received
0619 04:40:19.930399 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:19.930404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:19.930486 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:19.930579 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:19.931284 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.932171 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.933549 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:19.933975 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:19.934083 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:19.939423 (+ 5340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:48105: BlockingRecv error: recv got EOF from 127.9.224.65:48105 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Jun 19 04:40:20 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:20 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:20.284431 19338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:20.274592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:40999)
0619 04:40:20.275076 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:20.275092 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:20.275228 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:20.275614 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:20.275618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:20.276006 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:20.276185 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:20.276195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.277336 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.277340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:20.278485 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:20.278498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.279311 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.279315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:20.279458 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:20.280097 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:20.280115 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:20.284059 (+ 3944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":263,"threads_started":1}
W20260619 04:40:20.284543 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:20.274656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:40999 (local address 127.9.224.126:36197)
0619 04:40:20.274906 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:20.274913 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:20.275203 (+ 290us) server_negotiation.cc:407] Connection header received
0619 04:40:20.275341 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:20.275344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:20.275408 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:20.275519 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:20.276351 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.277162 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.278651 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.279155 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.279261 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:20.284316 (+ 5055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:40999: BlockingRecv error: recv got EOF from 127.9.224.66:40999 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Jun 19 04:40:20 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:20 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:20.745040 19339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:20.732908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:34739)
0619 04:40:20.733490 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:20.733506 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:20.733671 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:20.734109 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:20.734114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:20.734751 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:20.734984 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:20.734997 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.736253 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.736259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:20.738348 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:20.738371 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.739114 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.739121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:20.739321 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:20.740242 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:20.740272 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:20.744675 (+ 4403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":319,"threads_started":1}
W20260619 04:40:20.745139 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:20.732966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:34739 (local address 127.9.224.126:36197)
0619 04:40:20.733237 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:20.733245 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:20.733583 (+ 338us) server_negotiation.cc:407] Connection header received
0619 04:40:20.733810 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:20.733818 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:20.733935 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:20.734051 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:20.735147 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.736056 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.738511 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.738954 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.739085 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:20.744887 (+ 5802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:34739: BlockingRecv error: recv got EOF from 127.9.224.67:34739 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Jun 19 04:40:20 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:20 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:20.956342 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:20.940676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:50801)
0619 04:40:20.941289 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:20.941320 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:20.941494 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:20.941978 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:20.941984 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:20.942594 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:20.942839 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:20.942850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.944079 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.944083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:20.945424 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:20.945439 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.946464 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.946493 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:20.946689 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:20.952256 (+ 5567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:20.952274 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:20.956105 (+ 3831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":334,"threads_started":1}
W20260619 04:40:20.956564 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:20.940859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:50801 (local address 127.9.224.126:36197)
0619 04:40:20.941052 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:20.941057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:20.941441 (+ 384us) server_negotiation.cc:407] Connection header received
0619 04:40:20.941669 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:20.941675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:20.941767 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:20.941920 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:20.943002 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.943965 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.945587 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:20.946243 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:20.946397 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:20.956292 (+ 9895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:50801: BlockingRecv error: recv got EOF from 127.9.224.65:50801 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Jun 19 04:40:21 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:21 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:21.295008 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:21.285458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:45005)
0619 04:40:21.286008 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:21.286024 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:21.286136 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:21.286496 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:21.286499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:21.286910 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:21.287052 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:21.287060 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.288219 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.288223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:21.289331 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:21.289344 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.290095 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.290100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:21.290374 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:21.291062 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:21.291080 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:21.294702 (+ 3622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":298,"threads_started":1}
W20260619 04:40:21.295439 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:21.285628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:45005 (local address 127.9.224.126:36197)
0619 04:40:21.285816 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:21.285820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:21.286101 (+ 281us) server_negotiation.cc:407] Connection header received
0619 04:40:21.286282 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:21.286293 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:21.286369 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:21.286450 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:21.287206 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.288044 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.289486 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.289931 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.290033 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:21.294974 (+ 4941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:45005: BlockingRecv error: recv got EOF from 127.9.224.66:45005 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Jun 19 04:40:21 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:21 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:21.758177 19342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:21.748760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:38103)
0619 04:40:21.749299 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:21.749316 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:21.749441 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:21.749736 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:21.749739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:21.750171 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:21.750420 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:21.750437 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.751827 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.751831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:21.752824 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:21.752839 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.753583 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.753587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:21.753713 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:21.754289 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:21.754308 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:21.757955 (+ 3647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":307,"threads_started":1}
W20260619 04:40:21.758409 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:21.748878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:38103 (local address 127.9.224.126:36197)
0619 04:40:21.749065 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:21.749071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:21.749412 (+ 341us) server_negotiation.cc:407] Connection header received
0619 04:40:21.749529 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:21.749533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:21.749608 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:21.749693 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:21.750579 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.751653 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.752962 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.753431 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.753537 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:21.758149 (+ 4612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:38103: BlockingRecv error: recv got EOF from 127.9.224.67:38103 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Jun 19 04:40:21 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:21 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:21.966790 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:21.957416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:49645)
0619 04:40:21.957856 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:21.957877 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:21.958001 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:21.958349 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:21.958352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:21.958762 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:21.958948 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:21.958956 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.960014 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.960018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:21.960991 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:21.961003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.961760 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.961765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:21.961926 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:21.962669 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:21.962688 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:21.966548 (+ 3860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":239,"threads_started":1}
W20260619 04:40:21.966982 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:21.957474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:49645 (local address 127.9.224.126:36197)
0619 04:40:21.957712 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:21.957718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:21.957956 (+ 238us) server_negotiation.cc:407] Connection header received
0619 04:40:21.958105 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:21.958108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:21.958170 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:21.958311 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:21.959078 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.959844 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.961120 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:21.961572 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:21.961668 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:21.966748 (+ 5080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:49645: BlockingRecv error: recv got EOF from 127.9.224.65:49645 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Jun 19 04:40:22 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:22 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:22.305413 19344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:22.296125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:56501)
0619 04:40:22.296622 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:22.296637 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:22.296768 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:22.297113 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:22.297117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:22.297623 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:22.297794 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:22.297803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.298955 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.298959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:22.300141 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:22.300156 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.300998 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.301004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:22.301180 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:22.301869 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:22.301902 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:22.305182 (+ 3280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":289,"threads_started":1}
W20260619 04:40:22.305593 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:22.296226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:56501 (local address 127.9.224.126:36197)
0619 04:40:22.296455 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:22.296461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:22.296772 (+ 311us) server_negotiation.cc:407] Connection header received
0619 04:40:22.296890 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:22.296894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:22.296963 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:22.297049 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:22.297955 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.298817 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.300284 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.300825 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.300969 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:22.305372 (+ 4403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:56501: BlockingRecv error: recv got EOF from 127.9.224.66:56501 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Jun 19 04:40:22 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:22 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:22.769001 19345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:22.759100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:57313)
0619 04:40:22.759650 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:22.759667 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:22.759778 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:22.760217 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:22.760220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:22.760643 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:22.760835 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:22.760846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.762011 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.762015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:22.763106 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:22.763120 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.763978 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.763982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:22.764109 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:22.764823 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:22.764842 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:22.768641 (+ 3799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":326,"threads_started":1}
W20260619 04:40:22.769200 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:22.759237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:57313 (local address 127.9.224.126:36197)
0619 04:40:22.759411 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:22.759415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:22.759758 (+ 343us) server_negotiation.cc:407] Connection header received
0619 04:40:22.759929 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:22.759933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:22.760018 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:22.760113 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:22.761011 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.761772 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.763251 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.763807 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.763935 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:22.768888 (+ 4953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:57313: BlockingRecv error: recv got EOF from 127.9.224.67:57313 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Jun 19 04:40:22 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:22 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:22.976697 19346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:22.967890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:33629)
0619 04:40:22.968515 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:22.968535 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:22.968646 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:22.968923 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:22.968926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:22.969367 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:22.969542 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:22.969550 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.970698 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.970702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:22.971649 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:22.971660 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.972338 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.972342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:22.972458 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:22.973013 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:22.973030 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:22.976444 (+ 3414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":324,"threads_started":1}
W20260619 04:40:22.976850 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:22.967917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:33629 (local address 127.9.224.126:36197)
0619 04:40:22.968090 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:22.968094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:22.968606 (+ 512us) server_negotiation.cc:407] Connection header received
0619 04:40:22.968743 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:22.968746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:22.968803 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:22.968883 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:22.969663 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.970541 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.971781 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:22.972206 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:22.972308 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:22.976636 (+ 4328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:33629: BlockingRecv error: recv got EOF from 127.9.224.65:33629 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Jun 19 04:40:23 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:23 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:23.315840 19347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:23.306458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:52935)
0619 04:40:23.307259 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:23.307275 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:23.307448 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:23.307859 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:23.307865 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:23.308429 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:23.308662 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:23.308675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.309667 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.309671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:23.310647 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:23.310658 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.311336 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.311340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:23.311448 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:23.312008 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:23.312025 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:23.315477 (+ 3452us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":482,"threads_started":1}
W20260619 04:40:23.315953 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:23.306555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:52935 (local address 127.9.224.126:36197)
0619 04:40:23.306884 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:23.306894 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:23.307389 (+ 495us) server_negotiation.cc:407] Connection header received
0619 04:40:23.307613 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:23.307619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:23.307723 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:23.307810 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:23.308818 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.309547 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.310788 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.311204 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.311302 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:23.315684 (+ 4382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:52935: BlockingRecv error: recv got EOF from 127.9.224.66:52935 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
Jun 19 04:40:23 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:23 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:23.779906 19348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:23.770333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:43939)
0619 04:40:23.770915 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:23.770931 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:23.771050 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:23.771366 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:23.771369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:23.771782 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:23.771980 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:23.771996 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.773174 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.773179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:23.774561 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:23.774577 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.775534 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.775538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:23.775678 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:23.776285 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:23.776303 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:23.779625 (+ 3322us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":277,"threads_started":1}
W20260619 04:40:23.779980 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:23.770399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:43939 (local address 127.9.224.126:36197)
0619 04:40:23.770646 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:23.770656 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:23.771066 (+ 410us) server_negotiation.cc:407] Connection header received
0619 04:40:23.771132 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:23.771136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:23.771227 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:23.771311 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:23.772193 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.773007 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.774726 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.775393 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.775490 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:23.779808 (+ 4318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:43939: BlockingRecv error: recv got EOF from 127.9.224.67:43939 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Jun 19 04:40:23 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:23 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:23.987524 19349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:23.977816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:59961)
0619 04:40:23.978396 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:23.978417 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:23.978539 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:23.978903 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:23.978907 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:23.979366 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:23.979536 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:23.979545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.980734 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.980737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:23.981869 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:23.981883 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.982777 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.982784 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:23.982948 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:23.983594 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:23.983612 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:23.987163 (+ 3551us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":294,"threads_started":1}
W20260619 04:40:23.987625 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:23.977993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:59961 (local address 127.9.224.126:36197)
0619 04:40:23.978223 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:23.978274 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:23.978540 (+ 266us) server_negotiation.cc:407] Connection header received
0619 04:40:23.978633 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:23.978641 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:23.978711 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:23.978821 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:23.979706 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.980586 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.982053 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:23.982581 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:23.982741 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:23.987346 (+ 4605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:59961: BlockingRecv error: recv got EOF from 127.9.224.65:59961 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Jun 19 04:40:24 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:24 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:24.327152 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:24.316824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:35073)
0619 04:40:24.317304 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:24.317320 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:24.317437 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:24.317839 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:24.317842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:24.318279 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:24.318444 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:24.318453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.319794 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.319798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:24.320872 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:24.320885 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.321722 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.321727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:24.321840 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:24.322471 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:24.322489 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:24.326724 (+ 4235us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":240,"threads_started":1}
W20260619 04:40:24.327242 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:24.316963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:35073 (local address 127.9.224.126:36197)
0619 04:40:24.317228 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:24.317234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:24.317412 (+ 178us) server_negotiation.cc:407] Connection header received
0619 04:40:24.317612 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:24.317616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:24.317697 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:24.317783 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:24.318611 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.319617 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.321062 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.321502 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.321667 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:24.326969 (+ 5302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:35073: BlockingRecv error: recv got EOF from 127.9.224.66:35073 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Jun 19 04:40:24 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:24 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:24.789584 19351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:24.780994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:36479)
0619 04:40:24.781613 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:24.781635 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:24.781795 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:24.782084 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:24.782087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:24.782492 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:24.782648 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:24.782656 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.783618 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.783622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:24.784608 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:24.784619 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.785388 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.785392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:24.785501 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:24.786049 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:24.786072 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:24.789338 (+ 3266us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":300,"threads_started":1}
W20260619 04:40:24.789796 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:24.781084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:36479 (local address 127.9.224.126:36197)
0619 04:40:24.781297 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:24.781305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:24.781745 (+ 440us) server_negotiation.cc:407] Connection header received
0619 04:40:24.781884 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:24.781888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:24.781948 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:24.782024 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:24.782783 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.783502 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.784773 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.785231 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.785334 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:24.789537 (+ 4203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:36479: BlockingRecv error: recv got EOF from 127.9.224.67:36479 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Jun 19 04:40:24 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:24 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:24.998029 19352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:24.988669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:34889)
0619 04:40:24.989236 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:24.989260 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:24.989466 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:24.989793 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:24.989797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:24.990292 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:24.990482 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:24.990493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.991596 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.991601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:24.992575 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:24.992586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.993334 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.993339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:24.993473 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:24.994122 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:24.994140 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:24.997701 (+ 3561us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":305,"threads_started":1}
W20260619 04:40:24.998261 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:24.988704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:34889 (local address 127.9.224.126:36197)
0619 04:40:24.988999 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:24.989007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:24.989339 (+ 332us) server_negotiation.cc:407] Connection header received
0619 04:40:24.989584 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:24.989588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:24.989648 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:24.989728 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:24.990658 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.991438 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.992722 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:24.993160 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:24.993279 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:24.997941 (+ 4662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:34889: BlockingRecv error: recv got EOF from 127.9.224.65:34889 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Jun 19 04:40:25 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:25 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:25.338054 19353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:25.328305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:38481)
0619 04:40:25.328862 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:25.328883 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:25.329040 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:25.329490 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:25.329499 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:25.330094 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:25.330328 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:25.330343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.331507 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.331512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:25.332548 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:25.332560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.333289 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.333301 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:25.333444 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:25.334089 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:25.334108 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:25.337795 (+ 3687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":279,"threads_started":1}
W20260619 04:40:25.338296 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:25.328328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:38481 (local address 127.9.224.126:36197)
0619 04:40:25.328576 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:25.328583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:25.328990 (+ 407us) server_negotiation.cc:407] Connection header received
0619 04:40:25.329198 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:25.329207 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:25.329309 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:25.329414 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:25.330507 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.331383 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.332684 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.333123 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.333218 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:25.338028 (+ 4810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:38481: BlockingRecv error: recv got EOF from 127.9.224.66:38481 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Jun 19 04:40:25 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:25 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:25.800109 19354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:25.790716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:47625)
0619 04:40:25.791266 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:25.791282 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:25.791402 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:25.791735 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:25.791739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:25.792128 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:25.792270 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:25.792280 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.793370 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.793374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:25.794394 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:25.794408 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.795184 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.795188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:25.795326 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:25.796024 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:25.796043 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:25.799868 (+ 3825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":318,"threads_started":1}
W20260619 04:40:25.800275 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:25.790789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:47625 (local address 127.9.224.126:36197)
0619 04:40:25.790971 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:25.790976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:25.791369 (+ 393us) server_negotiation.cc:407] Connection header received
0619 04:40:25.791506 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:25.791509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:25.791570 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:25.791670 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:25.792439 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.793226 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.794564 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:25.795026 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:25.795130 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:25.800065 (+ 4935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:47625: BlockingRecv error: recv got EOF from 127.9.224.67:47625 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 19 04:40:26 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:26 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:26.012284 19355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:25.999285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:57005)
0619 04:40:25.999840 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:25.999860 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:25.999975 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:26.000258 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:26.000261 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:26.000665 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:26.000803 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:26.000812 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.001880 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.001884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:26.002927 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:26.002940 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.003637 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.003641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:26.003759 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:26.008490 (+ 4731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:26.008509 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:26.012042 (+ 3533us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":312,"threads_started":1}
W20260619 04:40:26.012584 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:25.999425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:57005 (local address 127.9.224.126:36197)
0619 04:40:25.999619 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:25.999623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:25.999934 (+ 311us) server_negotiation.cc:407] Connection header received
0619 04:40:26.000077 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:26.000080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:26.000141 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:26.000215 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:26.000938 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.001730 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.003053 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.003507 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.003601 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:26.012263 (+ 8662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:57005: BlockingRecv error: recv got EOF from 127.9.224.65:57005 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Jun 19 04:40:26 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:26 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:26.348152 19356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:26.339177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:55377)
0619 04:40:26.339700 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:26.339715 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:26.339875 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:26.340222 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:26.340226 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:26.340620 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:26.340783 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:26.340801 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.341838 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.341844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:26.342892 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:26.342931 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.343619 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.343624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:26.343794 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:26.344458 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:26.344475 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:26.347904 (+ 3429us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":278,"threads_started":1}
W20260619 04:40:26.348338 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:26.339277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:55377 (local address 127.9.224.126:36197)
0619 04:40:26.339512 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:26.339520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:26.339806 (+ 286us) server_negotiation.cc:407] Connection header received
0619 04:40:26.340010 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:26.340015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:26.340085 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:26.340188 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:26.340981 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.341696 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.343064 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.343473 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.343604 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:26.348102 (+ 4498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:55377: BlockingRecv error: recv got EOF from 127.9.224.66:55377 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Jun 19 04:40:26 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:26 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:26.810597 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:26.801232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:42257)
0619 04:40:26.801803 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:26.801819 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:26.801954 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:26.802288 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:26.802291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:26.802651 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:26.802811 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:26.802820 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.803873 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.803877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:26.804877 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:26.804897 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.805585 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.805589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:26.805706 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:26.806445 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:26.806463 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:26.810217 (+ 3754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":324,"threads_started":1}
W20260619 04:40:26.810726 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:26.801382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:42257 (local address 127.9.224.126:36197)
0619 04:40:26.801587 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:26.801592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:26.801909 (+ 317us) server_negotiation.cc:407] Connection header received
0619 04:40:26.802091 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:26.802095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:26.802159 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:26.802265 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:26.802949 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.803721 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.805012 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:26.805449 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:26.805542 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:26.810456 (+ 4914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:42257: BlockingRecv error: recv got EOF from 127.9.224.67:42257 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Jun 19 04:40:27 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:27 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:27.023334 19358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:27.013281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:43397)
0619 04:40:27.013818 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:27.013838 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:27.014007 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:27.014370 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:27.014376 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:27.014816 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:27.014994 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:27.015003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.016030 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.016036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:27.016964 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:27.016975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.017739 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.017745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:27.017940 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:27.018659 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:27.018707 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:27.023005 (+ 4298us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":287,"threads_started":1}
W20260619 04:40:27.023466 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:27.013394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:43397 (local address 127.9.224.126:36197)
0619 04:40:27.013685 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:27.013691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:27.013935 (+ 244us) server_negotiation.cc:407] Connection header received
0619 04:40:27.014132 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:27.014137 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:27.014204 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:27.014332 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:27.015132 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.015888 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.017110 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.017575 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.017731 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:27.023237 (+ 5506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:43397: BlockingRecv error: recv got EOF from 127.9.224.65:43397 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Jun 19 04:40:27 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:27 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:27.358063 19359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:27.349566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:53987)
0619 04:40:27.350182 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:27.350199 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:27.350332 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:27.350618 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:27.350621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:27.351055 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:27.351238 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:27.351247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.352269 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.352273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:27.353194 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:27.353205 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.353864 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.353868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:27.353986 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:27.354564 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:27.354582 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:27.357852 (+ 3270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":394,"threads_started":1}
W20260619 04:40:27.358374 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:27.349622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:53987 (local address 127.9.224.126:36197)
0619 04:40:27.349826 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:27.349833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:27.350294 (+ 461us) server_negotiation.cc:407] Connection header received
0619 04:40:27.350433 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:27.350436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:27.350496 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:27.350576 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:27.351398 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.352145 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.353338 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.353713 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.353812 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:27.358057 (+ 4245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:53987: BlockingRecv error: recv got EOF from 127.9.224.66:53987 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Jun 19 04:40:27 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:27 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:27.820595 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:27.811813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:56393)
0619 04:40:27.812288 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:27.812310 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:27.812422 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:27.812748 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:27.812751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:27.813190 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:27.813369 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:27.813378 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.814365 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.814370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:27.815315 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:27.815327 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.816035 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.816041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:27.816221 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:27.816861 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:27.816880 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:27.820217 (+ 3337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":282,"threads_started":1}
W20260619 04:40:27.820655 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:27.811997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:56393 (local address 127.9.224.126:36197)
0619 04:40:27.812235 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:27.812241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:27.812390 (+ 149us) server_negotiation.cc:407] Connection header received
0619 04:40:27.812519 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:27.812522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:27.812584 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:27.812666 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:27.813499 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.814247 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.815446 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:27.815868 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:27.816008 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:27.820427 (+ 4419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:56393: BlockingRecv error: recv got EOF from 127.9.224.67:56393 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Jun 19 04:40:28 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:28 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:28.034222 19361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:28.024557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:54661)
0619 04:40:28.025172 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:28.025194 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:28.025423 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:28.025815 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:28.025819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:28.026257 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:28.026423 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:28.026432 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.027450 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.027458 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:28.028438 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:28.028449 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.029239 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.029244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:28.029440 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:28.030069 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:28.030088 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:28.033840 (+ 3752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":354,"threads_started":1}
W20260619 04:40:28.034361 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:28.024607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:54661 (local address 127.9.224.126:36197)
0619 04:40:28.024906 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:28.024918 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:28.025303 (+ 385us) server_negotiation.cc:407] Connection header received
0619 04:40:28.025612 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:28.025615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:28.025679 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:28.025783 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:28.026566 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.027309 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.028576 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.029085 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.029217 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:28.034052 (+ 4835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:54661: BlockingRecv error: recv got EOF from 127.9.224.65:54661 (error 108)
Metrics: {"server-negotiator.queue_time_us":145}
Jun 19 04:40:28 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:28 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:28.368862 19362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:28.359202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:47229)
0619 04:40:28.359719 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:28.359735 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:28.359850 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:28.360145 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:28.360179 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:28.360783 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:28.361015 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:28.361027 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.362055 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.362061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:28.363550 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:28.363565 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.364260 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.364265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:28.364393 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:28.365052 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:28.365068 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:28.368627 (+ 3559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":270,"threads_started":1}
W20260619 04:40:28.369062 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:28.359253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:47229 (local address 127.9.224.126:36197)
0619 04:40:28.359499 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:28.359509 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:28.359832 (+ 323us) server_negotiation.cc:407] Connection header received
0619 04:40:28.359952 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:28.359956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:28.360017 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:28.360106 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:28.361158 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.361920 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.363696 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.364101 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.364191 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:28.368802 (+ 4611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:47229: BlockingRecv error: recv got EOF from 127.9.224.66:47229 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Jun 19 04:40:28 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:28 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:28.831489 19363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:28.821484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:42599)
0619 04:40:28.822055 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:28.822071 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:28.822194 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:28.822556 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:28.822560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:28.822945 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:28.823109 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:28.823118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.824220 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.824224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:28.825242 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:28.825256 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.825988 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.825992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:28.826133 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:28.826899 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:28.826924 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:28.831104 (+ 4180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":337,"threads_started":1}
W20260619 04:40:28.831691 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:28.821592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:42599 (local address 127.9.224.126:36197)
0619 04:40:28.821779 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:28.821784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:28.822150 (+ 366us) server_negotiation.cc:407] Connection header received
0619 04:40:28.822342 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:28.822345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:28.822412 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:28.822490 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:28.823251 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.824057 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.825385 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:28.825825 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:28.825923 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:28.831367 (+ 5444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:42599: BlockingRecv error: recv got EOF from 127.9.224.67:42599 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Jun 19 04:40:29 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:29 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:29.045326 19364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:29.035329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:51551)
0619 04:40:29.035871 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:29.035892 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:29.036010 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:29.036324 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:29.036328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:29.036745 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:29.036886 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:29.036894 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.037861 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.037864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:29.038864 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:29.038875 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.039810 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.039816 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:29.040001 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:29.040907 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:29.040933 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:29.045086 (+ 4153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":315,"threads_started":1}
W20260619 04:40:29.045571 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:29.035425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:51551 (local address 127.9.224.126:36197)
0619 04:40:29.035629 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:29.035634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:29.035983 (+ 349us) server_negotiation.cc:407] Connection header received
0619 04:40:29.036122 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:29.036127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:29.036190 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:29.036276 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:29.037025 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.037743 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.039022 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.039631 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.039798 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:29.045315 (+ 5517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:51551: BlockingRecv error: recv got EOF from 127.9.224.65:51551 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Jun 19 04:40:29 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:29 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:29.379068 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:29.369947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:36957)
0619 04:40:29.370491 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:29.370507 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:29.370655 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:29.371002 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:29.371005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:29.371415 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:29.371563 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:29.371573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.372613 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.372618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:29.373551 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:29.373562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.374342 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.374346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:29.374472 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:29.375142 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:29.375159 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:29.378735 (+ 3576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":321,"threads_started":1}
W20260619 04:40:29.379195 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:29.370091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:36957 (local address 127.9.224.126:36197)
0619 04:40:29.370335 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:29.370342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:29.370567 (+ 225us) server_negotiation.cc:407] Connection header received
0619 04:40:29.370808 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:29.370819 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:29.370882 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:29.370961 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:29.371716 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.372479 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.373689 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.374162 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.374326 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:29.378946 (+ 4620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:36957: BlockingRecv error: recv got EOF from 127.9.224.66:36957 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Jun 19 04:40:29 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:29 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.67@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:29.841527 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:29.832723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.67:35403)
0619 04:40:29.833228 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:29.833244 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:29.833391 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:29.833821 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:29.833828 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:29.834367 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:29.834506 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:29.834515 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.835513 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.835516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:29.836407 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:29.836418 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.837030 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.837034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:29.837161 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:29.837723 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:29.837740 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:29.841172 (+ 3432us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":236,"threads_started":1}
W20260619 04:40:29.841627 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:29.832773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:35403 (local address 127.9.224.126:36197)
0619 04:40:29.832970 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:29.832978 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:29.833323 (+ 345us) server_negotiation.cc:407] Connection header received
0619 04:40:29.833527 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:29.833532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:29.833643 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:29.833750 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:29.834659 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.835390 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.836529 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:29.836918 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:29.837006 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:29.841389 (+ 4383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.67:35403: BlockingRecv error: recv got EOF from 127.9.224.67:35403 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Jun 19 04:40:30 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:30 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.65@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:30.055871 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:30.046559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.65:42983)
0619 04:40:30.047079 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:30.047098 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:30.047279 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:30.047615 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:30.047621 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:30.048066 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:30.048248 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:30.048257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.049315 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.049321 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:30.050272 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:30.050284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.051017 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.051022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:30.051209 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.051810 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:30.051828 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:30.055504 (+ 3676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":260,"threads_started":1}
W20260619 04:40:30.056053 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:30.046682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:42983 (local address 127.9.224.126:36197)
0619 04:40:30.047001 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:30.047008 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:30.047209 (+ 201us) server_negotiation.cc:407] Connection header received
0619 04:40:30.047405 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:30.047410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:30.047484 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:30.047586 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:30.048400 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.049158 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.050416 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.050867 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.051002 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.055711 (+ 4709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.65:42983: BlockingRecv error: recv got EOF from 127.9.224.65:42983 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
Jun 19 04:40:30 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 04:40:30 dist-test-slave-9dgf krb5kdc[18318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.224.66@KRBTEST.COM for oryx/127.9.224.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 04:40:30.389820 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:30.380509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36197 (local address 127.9.224.66:40791)
0619 04:40:30.381016 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:30.381037 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:30.381171 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:30.381486 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:30.381491 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:30.381870 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:30.382092 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:30.382101 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.383207 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.383211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:30.384147 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:30.384158 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.385010 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.385018 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:30.385162 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.385884 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:30.385912 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:30.389553 (+ 3641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.224.126:36197: Server oryx/127.9.224.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":238,"threads_started":1}
W20260619 04:40:30.389961 19325 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:30.380681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:40791 (local address 127.9.224.126:36197)
0619 04:40:30.380912 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:30.380919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:30.381130 (+ 211us) server_negotiation.cc:407] Connection header received
0619 04:40:30.381292 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:30.381296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:30.381356 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:30.381436 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:30.382266 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.383067 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.384293 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.384867 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.384964 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.389728 (+ 4764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.224.66:40791: BlockingRecv error: recv got EOF from 127.9.224.66:40791 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
I20260619 04:40:30.458961 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18907
I20260619 04:40:30.472851 19370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:30.460211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39318 (local address 127.9.224.65:45781)
0619 04:40:30.460926 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:30.460934 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:30.460966 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:40:30.461033 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:30.461040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:30.461304 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:30.461480 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:30.463138 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.464279 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.465783 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.466476 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.466597 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.469304 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:30.469314 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:30.469328 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:30.469373 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:30.472116 (+ 2743us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.9.224.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0619 04:40:30.472502 (+ 386us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39318: Request ticket server kudu/127.9.224.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":358,"threads_started":1}
W20260619 04:40:30.472877 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18907: Not authorized: Client connection negotiation failed: client connection to 127.9.224.65:45781: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.9.224.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260619 04:40:30.472971 19370 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39318: Request ticket server kudu/127.9.224.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260619 04:40:30.473138 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18907
I20260619 04:40:30.490142 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19059
I20260619 04:40:30.503140 19371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:30.491347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52710 (local address 127.9.224.66:37711)
0619 04:40:30.492070 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:30.492079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:30.492115 (+ 36us) server_negotiation.cc:407] Connection header received
0619 04:40:30.492196 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:30.492205 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:30.492520 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:30.492763 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:30.494018 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.495193 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.496379 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.496937 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.497036 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.499728 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:30.499737 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:30.499751 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:30.499792 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:30.502571 (+ 2779us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.9.224.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0619 04:40:30.502855 (+ 284us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52710: Request ticket server kudu/127.9.224.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":361,"threads_started":1}
W20260619 04:40:30.503240 19371 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52710: Request ticket server kudu/127.9.224.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260619 04:40:30.503283 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19059: Not authorized: Client connection negotiation failed: client connection to 127.9.224.66:37711: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.9.224.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260619 04:40:30.503444 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19059
I20260619 04:40:30.519827 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19192
I20260619 04:40:30.533527 19372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:30.521030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54722 (local address 127.9.224.67:39185)
0619 04:40:30.521660 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:30.521666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:30.521691 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:40:30.521763 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:30.521770 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:30.522063 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:30.522291 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:30.524210 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.525267 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.526581 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:30.527171 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:30.527278 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:30.530088 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:30.530097 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:30.530133 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:30.530176 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:30.532949 (+ 2773us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.9.224.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0619 04:40:30.533251 (+ 302us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54722: Request ticket server kudu/127.9.224.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":324,"threads_started":1}
W20260619 04:40:30.533639 19372 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54722: Request ticket server kudu/127.9.224.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260619 04:40:30.533638 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19192: Not authorized: Client connection negotiation failed: client connection to 127.9.224.67:39185: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.9.224.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260619 04:40:30.533815 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19192
I20260619 04:40:30.550654 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 18838
I20260619 04:40:30.552320 18900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:30.670765 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 18838
2026-06-19T04:40:30Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21474 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-06-19T04:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:30Z Disabled control of system clock
I20260619 04:40:30.750572 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:44323
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:44323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260619 04:40:31.097816 19377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:31.098097 19377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:31.098176 19377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:31.105443 19377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:31.105561 19377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:31.105598 19377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:31.105648 19377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:31.105690 19377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:31.114856 19377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:44323
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:44323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:31.116246 19377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:31.118023 19377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:31.130174 19383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:31.130189 19385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:31.130447 19382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:31.131351 19377 server_base.cc:1034] running on GCE node
I20260619 04:40:31.132314 19377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:31.133904 19377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:31.135156 19377 hybrid_clock.cc:648] HybridClock initialized: now 1781844031135108 us; error 60 us; skew 500 ppm
I20260619 04:40:31.135551 19377 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:31.143262 19377 webserver.cc:460] Webserver started at http://127.9.224.126:33629/ using document root <none> and password file <none>
I20260619 04:40:31.144039 19377 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:31.144177 19377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:31.144516 19377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:31.147509 19377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "131f1dd5754f4d16accc6ee326e514c6"
format_stamp: "Formatted at 2026-06-19 04:40:31 on dist-test-slave-9dgf"
server_key: "3e9073484471bd2d652e5a00d0be4c66"
server_key_iv: "8927bbad1158c0b926881d843f985c5e"
server_key_version: "encryptionkey@0"
I20260619 04:40:31.148293 19377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "131f1dd5754f4d16accc6ee326e514c6"
format_stamp: "Formatted at 2026-06-19 04:40:31 on dist-test-slave-9dgf"
server_key: "3e9073484471bd2d652e5a00d0be4c66"
server_key_iv: "8927bbad1158c0b926881d843f985c5e"
server_key_version: "encryptionkey@0"
I20260619 04:40:31.153573 19377 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260619 04:40:31.157423 19391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:31.159010 19377 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:40:31.159209 19377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "131f1dd5754f4d16accc6ee326e514c6"
format_stamp: "Formatted at 2026-06-19 04:40:31 on dist-test-slave-9dgf"
server_key: "3e9073484471bd2d652e5a00d0be4c66"
server_key_iv: "8927bbad1158c0b926881d843f985c5e"
server_key_version: "encryptionkey@0"
I20260619 04:40:31.159449 19377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:31.184495 19377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:31.185398 19377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:31.185707 19377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:31.204763 19377 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:44323
I20260619 04:40:31.204751 19442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:44323 every 8 connection(s)
I20260619 04:40:31.206120 19377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:40:31.210296 19443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:31.213130 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19377
I20260619 04:40:31.213368 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:40:31.214388 10113 external_mini_cluster.cc:1428] Setting key 14ba59626e5b97074f04702afa94664c
I20260619 04:40:31.224458 19443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6: Bootstrap starting.
I20260619 04:40:31.228262 19443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:31.229012 19446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:31.216964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45928 (local address 127.9.224.126:44323)
0619 04:40:31.218111 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:31.218123 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:31.218164 (+ 41us) server_negotiation.cc:407] Connection header received
0619 04:40:31.219887 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:31.219909 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:31.220384 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:31.220805 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:31.221443 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:31.222880 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:31.224238 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:31.225011 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:31.225223 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:31.226537 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:31.226545 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:31.226560 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:31.227114 (+ 554us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:31.227215 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:31.227239 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:31.227383 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:31.227594 (+ 211us) server_negotiation.cc:299] Negotiation successful
0619 04:40:31.227928 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":469,"threads_started":1}
I20260619 04:40:31.229606 19443 log.cc:824] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:31.233263 19443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6: No bootstrap required, opened a new log
I20260619 04:40:31.243091 19443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "131f1dd5754f4d16accc6ee326e514c6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44323 } }
I20260619 04:40:31.243561 19443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:31.243693 19443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131f1dd5754f4d16accc6ee326e514c6, State: Initialized, Role: FOLLOWER
I20260619 04:40:31.244360 19443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "131f1dd5754f4d16accc6ee326e514c6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44323 } }
I20260619 04:40:31.244629 19443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:40:31.244822 19443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:40:31.245033 19443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:31.248160 19443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "131f1dd5754f4d16accc6ee326e514c6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44323 } }
I20260619 04:40:31.248723 19443 leader_election.cc:302] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 131f1dd5754f4d16accc6ee326e514c6; no voters:
I20260619 04:40:31.249377 19443 leader_election.cc:288] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:40:31.249524 19448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:31.250349 19448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [term 1 LEADER]: Becoming Leader. State: Replica: 131f1dd5754f4d16accc6ee326e514c6, State: Running, Role: LEADER
I20260619 04:40:31.251016 19448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "131f1dd5754f4d16accc6ee326e514c6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44323 } }
I20260619 04:40:31.251942 19443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:40:31.253882 19449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "131f1dd5754f4d16accc6ee326e514c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "131f1dd5754f4d16accc6ee326e514c6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44323 } } }
I20260619 04:40:31.254331 19449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:31.254961 19450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 131f1dd5754f4d16accc6ee326e514c6. Latest consensus state: current_term: 1 leader_uuid: "131f1dd5754f4d16accc6ee326e514c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "131f1dd5754f4d16accc6ee326e514c6" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 44323 } } }
I20260619 04:40:31.255332 19450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:31.255596 19454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:40:31.260843 19454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:40:31.271751 19454 catalog_manager.cc:1347] Generated new cluster ID: a8d16b651dae42bb9ab7d56d5c277d68
I20260619 04:40:31.271881 19454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:40:31.283557 19454 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:40:31.285526 19454 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:40:31.301348 19454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 131f1dd5754f4d16accc6ee326e514c6: Generated new TSK 0
I20260619 04:40:31.302492 19454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:40:31.317049 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44323
--builtin_ntp_servers=127.9.224.84:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260619 04:40:31.655939 19467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:31.656234 19467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:31.656337 19467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:31.664325 19467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:31.664433 19467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:31.664572 19467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:40:31.673769 19467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:31.675139 19467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:31.676952 19467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:31.690644 19473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:31.690766 19472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:31.691123 19475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:31.692042 19467 server_base.cc:1034] running on GCE node
I20260619 04:40:31.692677 19467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:31.693676 19467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:31.694917 19467 hybrid_clock.cc:648] HybridClock initialized: now 1781844031694855 us; error 57 us; skew 500 ppm
I20260619 04:40:31.695264 19467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:31.697587 19467 webserver.cc:460] Webserver started at http://127.9.224.65:36723/ using document root <none> and password file <none>
I20260619 04:40:31.698374 19467 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:31.698513 19467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:31.698835 19467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:31.701799 19467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "e87863bfc6734e2fb4651dcf8446f842"
format_stamp: "Formatted at 2026-06-19 04:40:31 on dist-test-slave-9dgf"
server_key: "132caf46ae3b08f58a74933760e22984"
server_key_iv: "c1c7700cf943bb9a3191b8c2d52c0f2b"
server_key_version: "encryptionkey@0"
I20260619 04:40:31.702708 19467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "e87863bfc6734e2fb4651dcf8446f842"
format_stamp: "Formatted at 2026-06-19 04:40:31 on dist-test-slave-9dgf"
server_key: "132caf46ae3b08f58a74933760e22984"
server_key_iv: "c1c7700cf943bb9a3191b8c2d52c0f2b"
server_key_version: "encryptionkey@0"
I20260619 04:40:31.708556 19467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:40:31.712446 19481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:31.714035 19467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:40:31.714308 19467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "e87863bfc6734e2fb4651dcf8446f842"
format_stamp: "Formatted at 2026-06-19 04:40:31 on dist-test-slave-9dgf"
server_key: "132caf46ae3b08f58a74933760e22984"
server_key_iv: "c1c7700cf943bb9a3191b8c2d52c0f2b"
server_key_version: "encryptionkey@0"
I20260619 04:40:31.714572 19467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:31.728531 19467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:31.729425 19467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:31.729727 19467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:31.730729 19467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:31.732147 19467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:31.732273 19467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:31.732398 19467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:31.732486 19467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:31.766062 19467 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:41849
I20260619 04:40:31.766120 19593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:41849 every 8 connection(s)
I20260619 04:40:31.767524 19467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:40:31.771128 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19467
I20260619 04:40:31.771323 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:40:31.772166 10113 external_mini_cluster.cc:1428] Setting key 3906856c841122dfa05eb91d4ac803ae
I20260619 04:40:31.775550 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44323
--builtin_ntp_servers=127.9.224.84:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260619 04:40:31.783412 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:31.770320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:57237 (local address 127.9.224.126:44323)
0619 04:40:31.770847 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:31.770855 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:31.772371 (+ 1516us) server_negotiation.cc:407] Connection header received
0619 04:40:31.774642 (+ 2271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:31.774647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:31.774712 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:31.774805 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:31.776356 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:31.777109 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:31.779730 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:31.780377 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:31.780502 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:31.782402 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:31.782407 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:31.782410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:31.782431 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:31.782478 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:31.782490 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:31.782581 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:31.782871 (+ 290us) server_negotiation.cc:299] Negotiation successful
0619 04:40:31.782963 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":230,"threads_started":1}
I20260619 04:40:31.784418 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:31.770977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44323 (local address 127.9.224.65:57237)
0619 04:40:31.772182 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:31.772240 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:31.774297 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:31.775116 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:31.775130 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:31.775269 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:31.776149 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:31.776179 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:31.777284 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:31.777292 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:31.779548 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:31.779569 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:31.780651 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:31.780661 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:31.781035 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:31.781945 (+ 910us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:40:31.781951 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:31.782020 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:40:31.782144 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:31.782612 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:31.782626 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:31.782638 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 04:40:31.782842 (+ 204us) client_negotiation.cc:240] Negotiation successful
0619 04:40:31.783260 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":339,"threads_started":1}
I20260619 04:40:31.786105 19594 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44323
I20260619 04:40:31.786448 19594 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:31.787246 19594 heartbeater.cc:511] Master 127.9.224.126:44323 requested a full tablet report, sending...
I20260619 04:40:31.789351 19408 ts_manager.cc:194] Registered new tserver with Master: e87863bfc6734e2fb4651dcf8446f842 (127.9.224.65:41849)
I20260619 04:40:31.790979 19408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.65:57237
W20260619 04:40:32.112262 19598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:32.112553 19598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:32.112697 19598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:32.120518 19598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:32.120635 19598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:32.120802 19598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:40:32.130348 19598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:32.131759 19598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:32.133685 19598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:32.147766 19603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:32.147766 19606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:32.147990 19604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:32.148469 19598 server_base.cc:1034] running on GCE node
I20260619 04:40:32.149374 19598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:32.150538 19598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:32.151780 19598 hybrid_clock.cc:648] HybridClock initialized: now 1781844032151736 us; error 42 us; skew 500 ppm
I20260619 04:40:32.152124 19598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:32.154855 19598 webserver.cc:460] Webserver started at http://127.9.224.66:38925/ using document root <none> and password file <none>
I20260619 04:40:32.155649 19598 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:32.155787 19598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:32.156132 19598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:32.159382 19598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "f311fe6d012f412391a0f4453eda4b9c"
format_stamp: "Formatted at 2026-06-19 04:40:32 on dist-test-slave-9dgf"
server_key: "7fa2d1625daf226d3cef017bc32663b5"
server_key_iv: "6fc18ec7012a3fca8b7161c69e753ca4"
server_key_version: "encryptionkey@0"
I20260619 04:40:32.160356 19598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "f311fe6d012f412391a0f4453eda4b9c"
format_stamp: "Formatted at 2026-06-19 04:40:32 on dist-test-slave-9dgf"
server_key: "7fa2d1625daf226d3cef017bc32663b5"
server_key_iv: "6fc18ec7012a3fca8b7161c69e753ca4"
server_key_version: "encryptionkey@0"
I20260619 04:40:32.166612 19598 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260619 04:40:32.170926 19612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:32.172545 19598 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260619 04:40:32.172775 19598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "f311fe6d012f412391a0f4453eda4b9c"
format_stamp: "Formatted at 2026-06-19 04:40:32 on dist-test-slave-9dgf"
server_key: "7fa2d1625daf226d3cef017bc32663b5"
server_key_iv: "6fc18ec7012a3fca8b7161c69e753ca4"
server_key_version: "encryptionkey@0"
I20260619 04:40:32.173029 19598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:32.190714 19598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:32.191679 19598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:32.192008 19598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:32.193038 19598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:32.194563 19598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:32.194684 19598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:32.194826 19598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:32.194919 19598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:32.236776 19598 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:38529
I20260619 04:40:32.236836 19724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:38529 every 8 connection(s)
I20260619 04:40:32.238133 19598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:40:32.241779 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19598
I20260619 04:40:32.241990 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:40:32.242590 10113 external_mini_cluster.cc:1428] Setting key 5588fb487785084716c52b51e90c499f
I20260619 04:40:32.245488 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44323
--builtin_ntp_servers=127.9.224.84:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260619 04:40:32.251675 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.240941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:41985 (local address 127.9.224.126:44323)
0619 04:40:32.241142 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:32.241147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:32.242831 (+ 1684us) server_negotiation.cc:407] Connection header received
0619 04:40:32.244823 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:32.244828 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:32.244919 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:32.245025 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:32.246218 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.246976 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.248677 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.249093 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.249231 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.250831 (+ 1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:32.250837 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:32.250841 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:32.250863 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:32.250895 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:32.250908 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:32.251009 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:32.251239 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 04:40:32.251359 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:40:32.252871 19727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.241426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44323 (local address 127.9.224.66:41985)
0619 04:40:32.242623 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:32.242679 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:32.244551 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:32.245283 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:32.245292 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:32.245387 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:32.246054 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:32.246072 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.247147 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.247157 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:32.248521 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:32.248534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.249340 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.249348 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:32.249589 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.250450 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:40:32.250453 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:32.250497 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:40:32.250601 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:32.251005 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:32.251017 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:32.251028 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 04:40:32.251230 (+ 202us) client_negotiation.cc:240] Negotiation successful
0619 04:40:32.251672 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":375,"threads_started":1}
I20260619 04:40:32.254827 19725 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44323
I20260619 04:40:32.255223 19725 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:32.256069 19725 heartbeater.cc:511] Master 127.9.224.126:44323 requested a full tablet report, sending...
I20260619 04:40:32.257608 19408 ts_manager.cc:194] Registered new tserver with Master: f311fe6d012f412391a0f4453eda4b9c (127.9.224.66:38529)
I20260619 04:40:32.258505 19408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.66:41985
W20260619 04:40:32.583832 19728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:32.584142 19728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:32.584286 19728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:32.591845 19728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:32.591964 19728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:32.592150 19728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:40:32.601686 19728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:44323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:32.603096 19728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:32.604918 19728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:32.618414 19736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:32.618482 19734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:32.618512 19733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:32.619549 19728 server_base.cc:1034] running on GCE node
I20260619 04:40:32.620167 19728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:32.621085 19728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:32.622337 19728 hybrid_clock.cc:648] HybridClock initialized: now 1781844032622276 us; error 68 us; skew 500 ppm
I20260619 04:40:32.622677 19728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:32.625011 19728 webserver.cc:460] Webserver started at http://127.9.224.67:35363/ using document root <none> and password file <none>
I20260619 04:40:32.625733 19728 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:32.625874 19728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:32.626204 19728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:32.629068 19728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "fd1d2ecc2fe747678554f2f377e4490e"
format_stamp: "Formatted at 2026-06-19 04:40:32 on dist-test-slave-9dgf"
server_key: "8f80a9b4c4a8485044f12c936c6c4ed1"
server_key_iv: "c8400fa110f070dfe5cbe68d2de32597"
server_key_version: "encryptionkey@0"
I20260619 04:40:32.629856 19728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "fd1d2ecc2fe747678554f2f377e4490e"
format_stamp: "Formatted at 2026-06-19 04:40:32 on dist-test-slave-9dgf"
server_key: "8f80a9b4c4a8485044f12c936c6c4ed1"
server_key_iv: "c8400fa110f070dfe5cbe68d2de32597"
server_key_version: "encryptionkey@0"
I20260619 04:40:32.635078 19728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260619 04:40:32.638592 19742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:32.640096 19728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:40:32.640291 19728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "fd1d2ecc2fe747678554f2f377e4490e"
format_stamp: "Formatted at 2026-06-19 04:40:32 on dist-test-slave-9dgf"
server_key: "8f80a9b4c4a8485044f12c936c6c4ed1"
server_key_iv: "c8400fa110f070dfe5cbe68d2de32597"
server_key_version: "encryptionkey@0"
I20260619 04:40:32.640528 19728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:32.660569 19728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:32.661479 19728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:32.661798 19728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:32.662863 19728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:32.664558 19728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:32.664678 19728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:32.664812 19728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:32.664906 19728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:32.699079 19728 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33595
I20260619 04:40:32.699122 19854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33595 every 8 connection(s)
I20260619 04:40:32.700491 19728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:40:32.710678 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19728
I20260619 04:40:32.710839 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:40:32.711282 10113 external_mini_cluster.cc:1428] Setting key a5aa839eee82627a6edb06b9464664fb
I20260619 04:40:32.713774 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.703291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:43723 (local address 127.9.224.126:44323)
0619 04:40:32.703517 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:32.703521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:32.704992 (+ 1471us) server_negotiation.cc:407] Connection header received
0619 04:40:32.706917 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:32.706923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:32.707021 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:32.707133 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:32.708238 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.708982 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.710640 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.711167 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.711305 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.712797 (+ 1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:32.712803 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:32.712806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:32.712832 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:32.712864 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:32.712876 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:32.712946 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:32.713258 (+ 312us) server_negotiation.cc:299] Negotiation successful
0619 04:40:32.713406 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 04:40:32.714980 19857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.703874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:44323 (local address 127.9.224.67:43723)
0619 04:40:32.704794 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:32.704839 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:32.706622 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:32.707380 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:32.707388 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:32.707481 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:32.708065 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:32.708082 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.709140 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.709149 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:32.710491 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:32.710504 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.711396 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.711403 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:32.711643 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.712386 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:40:32.712390 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:32.712448 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:40:32.712582 (+ 134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:32.712975 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:32.712986 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:32.712995 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 04:40:32.713183 (+ 188us) client_negotiation.cc:240] Negotiation successful
0619 04:40:32.713628 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":274,"threads_started":1}
I20260619 04:40:32.716384 19855 heartbeater.cc:347] Connected to a master server at 127.9.224.126:44323
I20260619 04:40:32.716740 19855 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:32.717501 19855 heartbeater.cc:511] Master 127.9.224.126:44323 requested a full tablet report, sending...
I20260619 04:40:32.719005 19408 ts_manager.cc:194] Registered new tserver with Master: fd1d2ecc2fe747678554f2f377e4490e (127.9.224.67:33595)
I20260619 04:40:32.719936 19408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.67:43723
I20260619 04:40:32.727242 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 04:40:32.733340 19596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:32.731933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45942 (local address 127.9.224.126:44323)
0619 04:40:32.732107 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:32.732112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:32.732507 (+ 395us) server_negotiation.cc:407] Connection header received
0619 04:40:32.732626 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:32.732630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:32.732692 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:32.732773 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:32.733161 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45942: BlockingRecv error: recv got EOF from 127.0.0.1:45942 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:40:32.734009 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19467
I20260619 04:40:32.745607 19864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.735259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56322 (local address 127.9.224.65:41849)
0619 04:40:32.735767 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:32.735775 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:32.735810 (+ 35us) server_negotiation.cc:407] Connection header received
0619 04:40:32.735869 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:32.735875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:32.736089 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:32.736272 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:32.737090 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.738927 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.741044 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.741987 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.742135 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.743593 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:32.743607 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:32.743629 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:32.744523 (+ 894us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:32.744575 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:32.744602 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:32.744731 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:32.744949 (+ 218us) server_negotiation.cc:299] Negotiation successful
0619 04:40:32.745119 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":260,"threads_started":1}
I20260619 04:40:32.747049 19589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:32.829619 19594 heartbeater.cc:503] Master 127.9.224.126:44323 was elected leader, sending a full tablet report...
I20260619 04:40:32.831262 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19467
I20260619 04:40:32.848860 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19598
I20260619 04:40:32.857066 19866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.849829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36304 (local address 127.9.224.66:38529)
0619 04:40:32.850420 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:32.850427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:32.850453 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:40:32.850526 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:32.850533 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:32.850746 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:32.850874 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:32.851258 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.852357 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.853630 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.854225 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.854376 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.855356 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:32.855363 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:32.855377 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:32.856116 (+ 739us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:32.856173 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:32.856193 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:32.856279 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:32.856435 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 04:40:32.856689 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":331,"threads_started":1}
I20260619 04:40:32.858508 19720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:32.940900 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19598
I20260619 04:40:32.957547 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19728
I20260619 04:40:32.966132 19868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:32.958554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60650 (local address 127.9.224.67:33595)
0619 04:40:32.959185 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:32.959192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:32.959224 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:40:32.959282 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:32.959288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:32.959518 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:32.959683 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:32.960079 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.961141 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.962555 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:32.963254 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:32.963351 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:32.964576 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:32.964586 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:32.964600 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:32.965280 (+ 680us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:32.965326 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:32.965346 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:32.965435 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:32.965576 (+ 141us) server_negotiation.cc:299] Negotiation successful
0619 04:40:32.965754 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":333,"threads_started":1}
I20260619 04:40:32.967456 19850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:33.051141 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19728
I20260619 04:40:33.068068 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19377
I20260619 04:40:33.069314 19438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:33.171401 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19377
2026-06-19T04:40:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2495 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-06-19T04:40:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:33Z Disabled control of system clock
I20260619 04:40:33.244287 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:45073
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:45073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 04:40:33.581869 19874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:33.582176 19874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:33.582330 19874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:33.589874 19874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:33.590003 19874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:33.590040 19874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:33.590090 19874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:33.590132 19874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:33.599640 19874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:45073
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:45073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:33.600984 19874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:33.602914 19874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:33.615505 19879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:33.615528 19882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:33.615473 19880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:33.616498 19874 server_base.cc:1034] running on GCE node
I20260619 04:40:33.617353 19874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:33.618925 19874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:33.620149 19874 hybrid_clock.cc:648] HybridClock initialized: now 1781844033620080 us; error 57 us; skew 500 ppm
I20260619 04:40:33.620499 19874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:33.623142 19874 webserver.cc:460] Webserver started at http://127.9.224.126:45511/ using document root <none> and password file <none>
I20260619 04:40:33.623840 19874 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:33.623944 19874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:33.624218 19874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:33.627372 19874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "b91e9401e9434073a04e464f0c27d3fc"
format_stamp: "Formatted at 2026-06-19 04:40:33 on dist-test-slave-9dgf"
server_key: "0143747eb6fd1060598778c6cd144924"
server_key_iv: "e97c8c1d7ed656b68c93cd924879bc30"
server_key_version: "encryptionkey@0"
I20260619 04:40:33.628157 19874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "b91e9401e9434073a04e464f0c27d3fc"
format_stamp: "Formatted at 2026-06-19 04:40:33 on dist-test-slave-9dgf"
server_key: "0143747eb6fd1060598778c6cd144924"
server_key_iv: "e97c8c1d7ed656b68c93cd924879bc30"
server_key_version: "encryptionkey@0"
I20260619 04:40:33.633599 19874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:40:33.637490 19888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:33.639348 19874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 04:40:33.639544 19874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "b91e9401e9434073a04e464f0c27d3fc"
format_stamp: "Formatted at 2026-06-19 04:40:33 on dist-test-slave-9dgf"
server_key: "0143747eb6fd1060598778c6cd144924"
server_key_iv: "e97c8c1d7ed656b68c93cd924879bc30"
server_key_version: "encryptionkey@0"
I20260619 04:40:33.639786 19874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:33.646015 19874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:33.646935 19874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:33.647254 19874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:33.666989 19874 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:45073
I20260619 04:40:33.667023 19939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:45073 every 8 connection(s)
I20260619 04:40:33.668445 19874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:40:33.672291 19940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:33.677013 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19874
I20260619 04:40:33.677237 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:40:33.678082 10113 external_mini_cluster.cc:1428] Setting key 2b695e549cd73a4a73ad52ece73e630e
I20260619 04:40:33.684451 19940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc: Bootstrap starting.
I20260619 04:40:33.686964 19943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:33.680285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52302 (local address 127.9.224.126:45073)
0619 04:40:33.681348 (+ 1063us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:33.681359 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:33.681399 (+ 40us) server_negotiation.cc:407] Connection header received
0619 04:40:33.683315 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:33.683339 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:33.683766 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:33.684158 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:33.685279 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:33.685285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:33.685297 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:33.685314 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:33.685368 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:33.685383 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:33.685613 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:33.685751 (+ 138us) server_negotiation.cc:299] Negotiation successful
0619 04:40:33.686009 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":365,"threads_started":1}
I20260619 04:40:33.687811 19940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:33.688824 19940 log.cc:824] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:33.691506 19940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc: No bootstrap required, opened a new log
I20260619 04:40:33.698328 19940 raft_consensus.cc:348] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91e9401e9434073a04e464f0c27d3fc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45073 } }
I20260619 04:40:33.698725 19940 raft_consensus.cc:374] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:33.698829 19940 raft_consensus.cc:729] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91e9401e9434073a04e464f0c27d3fc, State: Initialized, Role: FOLLOWER
I20260619 04:40:33.699375 19940 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91e9401e9434073a04e464f0c27d3fc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45073 } }
I20260619 04:40:33.699630 19940 raft_consensus.cc:388] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:40:33.699790 19940 raft_consensus.cc:482] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:40:33.700050 19940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:33.702324 19940 raft_consensus.cc:504] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91e9401e9434073a04e464f0c27d3fc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45073 } }
I20260619 04:40:33.702848 19940 leader_election.cc:302] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b91e9401e9434073a04e464f0c27d3fc; no voters:
I20260619 04:40:33.703423 19940 leader_election.cc:288] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:40:33.703584 19945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:33.704294 19945 raft_consensus.cc:686] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [term 1 LEADER]: Becoming Leader. State: Replica: b91e9401e9434073a04e464f0c27d3fc, State: Running, Role: LEADER
I20260619 04:40:33.704882 19945 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91e9401e9434073a04e464f0c27d3fc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45073 } }
I20260619 04:40:33.705541 19940 sys_catalog.cc:564] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:40:33.707782 19946 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b91e9401e9434073a04e464f0c27d3fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91e9401e9434073a04e464f0c27d3fc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45073 } } }
I20260619 04:40:33.707695 19947 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91e9401e9434073a04e464f0c27d3fc. Latest consensus state: current_term: 1 leader_uuid: "b91e9401e9434073a04e464f0c27d3fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91e9401e9434073a04e464f0c27d3fc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45073 } } }
I20260619 04:40:33.708179 19947 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:33.708176 19946 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:33.709299 19951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:40:33.715754 19951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:40:33.724673 19951 catalog_manager.cc:1347] Generated new cluster ID: 14e641e1c1da48cfaf59a0e957a4d137
I20260619 04:40:33.724798 19951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:40:33.738201 19951 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:40:33.738732 19951 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:40:33.746554 19951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b91e9401e9434073a04e464f0c27d3fc: Generated new TSK 0
I20260619 04:40:33.747380 19951 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:40:33.756919 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45073
--builtin_ntp_servers=127.9.224.84:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 04:40:34.092928 19964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:34.093228 19964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:34.093380 19964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:34.100865 19964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:34.100979 19964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:34.101159 19964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:40:34.110860 19964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:34.112227 19964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:34.114049 19964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:34.128329 19969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:34.128298 19970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:34.128351 19972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:34.130326 19964 server_base.cc:1034] running on GCE node
I20260619 04:40:34.131168 19964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:34.132243 19964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:34.133545 19964 hybrid_clock.cc:648] HybridClock initialized: now 1781844034133494 us; error 40 us; skew 500 ppm
I20260619 04:40:34.134135 19964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:34.136998 19964 webserver.cc:460] Webserver started at http://127.9.224.65:43331/ using document root <none> and password file <none>
I20260619 04:40:34.137766 19964 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:34.137912 19964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:34.138345 19964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:34.143775 19964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "691abc0c4b994025b8c61bdf044e7b91"
format_stamp: "Formatted at 2026-06-19 04:40:34 on dist-test-slave-9dgf"
server_key: "9056bef6f1fb1a3f96d71219de593437"
server_key_iv: "f2c995ea850caeba165ac96ac94078be"
server_key_version: "encryptionkey@0"
I20260619 04:40:34.144752 19964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "691abc0c4b994025b8c61bdf044e7b91"
format_stamp: "Formatted at 2026-06-19 04:40:34 on dist-test-slave-9dgf"
server_key: "9056bef6f1fb1a3f96d71219de593437"
server_key_iv: "f2c995ea850caeba165ac96ac94078be"
server_key_version: "encryptionkey@0"
I20260619 04:40:34.150664 19964 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 04:40:34.154781 19978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:34.156306 19964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:40:34.156514 19964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "691abc0c4b994025b8c61bdf044e7b91"
format_stamp: "Formatted at 2026-06-19 04:40:34 on dist-test-slave-9dgf"
server_key: "9056bef6f1fb1a3f96d71219de593437"
server_key_iv: "f2c995ea850caeba165ac96ac94078be"
server_key_version: "encryptionkey@0"
I20260619 04:40:34.156761 19964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:34.162881 19964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:34.163743 19964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:34.164040 19964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:34.164999 19964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:34.166599 19964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:34.166721 19964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:34.166898 19964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:34.166996 19964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:34.202347 19964 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:32795
I20260619 04:40:34.202416 20090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:32795 every 8 connection(s)
I20260619 04:40:34.203823 19964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:40:34.210670 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 19964
I20260619 04:40:34.210944 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:40:34.211704 10113 external_mini_cluster.cc:1428] Setting key ba7c94dcdbd13015bcfd3833f4731e1d
I20260619 04:40:34.213227 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:34.206712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:58471 (local address 127.9.224.126:45073)
0619 04:40:34.207242 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:34.207246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:34.208541 (+ 1295us) server_negotiation.cc:407] Connection header received
0619 04:40:34.210524 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:34.210530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:34.210610 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:34.210739 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:34.212337 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:34.212343 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:34.212355 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:34.212371 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:34.212412 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:34.212424 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:34.212548 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:34.212899 (+ 351us) server_negotiation.cc:299] Negotiation successful
0619 04:40:34.212965 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"spinlock_wait_cycles":46336,"thread_start_us":322,"threads_started":1}
I20260619 04:40:34.214510 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:34.207406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45073 (local address 127.9.224.65:58471)
0619 04:40:34.208375 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:34.208413 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:34.210109 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:34.211047 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:34.211060 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:34.211200 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:34.211979 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:40:34.211981 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:34.212023 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:40:34.212114 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:34.212565 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:34.212574 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:34.212581 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 04:40:34.213004 (+ 423us) client_negotiation.cc:240] Negotiation successful
0619 04:40:34.213316 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":264,"threads_started":1}
I20260619 04:40:34.214998 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45073
--builtin_ntp_servers=127.9.224.84:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260619 04:40:34.216192 20091 heartbeater.cc:347] Connected to a master server at 127.9.224.126:45073
I20260619 04:40:34.216596 20091 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:34.217206 20091 heartbeater.cc:511] Master 127.9.224.126:45073 requested a full tablet report, sending...
I20260619 04:40:34.219394 19905 ts_manager.cc:194] Registered new tserver with Master: 691abc0c4b994025b8c61bdf044e7b91 (127.9.224.65:32795)
W20260619 04:40:34.548300 20095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:34.548599 20095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:34.548751 20095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:34.556123 20095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:34.556227 20095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:34.556406 20095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:40:34.565900 20095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:34.567315 20095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:34.569068 20095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:34.582461 20100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:34.582508 20101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:34.582424 20103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:34.588060 20095 server_base.cc:1034] running on GCE node
I20260619 04:40:34.588717 20095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:34.589757 20095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:34.590997 20095 hybrid_clock.cc:648] HybridClock initialized: now 1781844034590951 us; error 57 us; skew 500 ppm
I20260619 04:40:34.591336 20095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:34.593722 20095 webserver.cc:460] Webserver started at http://127.9.224.66:46437/ using document root <none> and password file <none>
I20260619 04:40:34.594498 20095 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:34.594626 20095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:34.594949 20095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:34.597811 20095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "46659dbf4aad427c8f28742596fa1e2d"
format_stamp: "Formatted at 2026-06-19 04:40:34 on dist-test-slave-9dgf"
server_key: "c304ee65b74f30557727ad8170dfd39d"
server_key_iv: "caa2751b764762cc30a434b5f3e1b4d9"
server_key_version: "encryptionkey@0"
I20260619 04:40:34.598659 20095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "46659dbf4aad427c8f28742596fa1e2d"
format_stamp: "Formatted at 2026-06-19 04:40:34 on dist-test-slave-9dgf"
server_key: "c304ee65b74f30557727ad8170dfd39d"
server_key_iv: "caa2751b764762cc30a434b5f3e1b4d9"
server_key_version: "encryptionkey@0"
I20260619 04:40:34.603955 20095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:40:34.607708 20109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:34.609218 20095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:40:34.609422 20095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "46659dbf4aad427c8f28742596fa1e2d"
format_stamp: "Formatted at 2026-06-19 04:40:34 on dist-test-slave-9dgf"
server_key: "c304ee65b74f30557727ad8170dfd39d"
server_key_iv: "caa2751b764762cc30a434b5f3e1b4d9"
server_key_version: "encryptionkey@0"
I20260619 04:40:34.609681 20095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:34.615585 20095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:34.616412 20095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:34.616684 20095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:34.617650 20095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:34.619186 20095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:34.619306 20095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:34.619453 20095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:34.619542 20095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:34.654156 20095 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:39709
I20260619 04:40:34.654209 20221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:39709 every 8 connection(s)
I20260619 04:40:34.655555 20095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:40:34.659163 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 20095
I20260619 04:40:34.659361 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:40:34.660022 10113 external_mini_cluster.cc:1428] Setting key e92ec44f9d651a7f5d0d87ab5af5f9b7
I20260619 04:40:34.663642 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45073
--builtin_ntp_servers=127.9.224.84:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260619 04:40:34.667295 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:34.658670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:34893 (local address 127.9.224.126:45073)
0619 04:40:34.658904 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:34.658911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:34.661219 (+ 2308us) server_negotiation.cc:407] Connection header received
0619 04:40:34.664123 (+ 2904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:34.664133 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:34.664210 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:34.664289 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:34.666420 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:34.666426 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:34.666431 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:34.666453 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:34.666501 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:34.666516 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:34.666660 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:34.666905 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 04:40:34.666978 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:40:34.668635 20224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:34.659585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45073 (local address 127.9.224.66:34893)
0619 04:40:34.661053 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:34.661103 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:34.663749 (+ 2646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:34.664859 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:34.664875 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:34.665039 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:34.665941 (+ 902us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:40:34.665948 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:34.666019 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:40:34.666158 (+ 139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:34.666650 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:34.666664 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:34.666676 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 04:40:34.666986 (+ 310us) client_negotiation.cc:240] Negotiation successful
0619 04:40:34.667272 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"thread_start_us":405,"threads_started":1}
I20260619 04:40:34.670264 20222 heartbeater.cc:347] Connected to a master server at 127.9.224.126:45073
I20260619 04:40:34.670614 20222 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:34.671365 20222 heartbeater.cc:511] Master 127.9.224.126:45073 requested a full tablet report, sending...
I20260619 04:40:34.673192 19905 ts_manager.cc:194] Registered new tserver with Master: 46659dbf4aad427c8f28742596fa1e2d (127.9.224.66:39709)
W20260619 04:40:35.009534 20225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:35.009876 20225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:35.010046 20225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:35.017823 20225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:35.017921 20225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:35.018088 20225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:40:35.027508 20225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:35.028787 20225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:35.030618 20225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:35.043641 20230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:35.043634 20231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:35.043804 20233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:35.044448 20225 server_base.cc:1034] running on GCE node
I20260619 04:40:35.045131 20225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:35.046047 20225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:35.047279 20225 hybrid_clock.cc:648] HybridClock initialized: now 1781844035047204 us; error 69 us; skew 500 ppm
I20260619 04:40:35.047569 20225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:40:35.049755 20225 webserver.cc:460] Webserver started at http://127.9.224.67:46039/ using document root <none> and password file <none>
I20260619 04:40:35.050527 20225 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:35.050654 20225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:35.050982 20225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:35.053819 20225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "0b9a40ce831d4695af047f08eba6a546"
format_stamp: "Formatted at 2026-06-19 04:40:35 on dist-test-slave-9dgf"
server_key: "2209ca4b819cf67484aa2d3a36f3acc7"
server_key_iv: "3b11bcbd180b5a383fda6e7e7bd373c5"
server_key_version: "encryptionkey@0"
I20260619 04:40:35.054664 20225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "0b9a40ce831d4695af047f08eba6a546"
format_stamp: "Formatted at 2026-06-19 04:40:35 on dist-test-slave-9dgf"
server_key: "2209ca4b819cf67484aa2d3a36f3acc7"
server_key_iv: "3b11bcbd180b5a383fda6e7e7bd373c5"
server_key_version: "encryptionkey@0"
I20260619 04:40:35.059659 20225 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 04:40:35.063055 20239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:35.064357 20225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:40:35.064481 20225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "0b9a40ce831d4695af047f08eba6a546"
format_stamp: "Formatted at 2026-06-19 04:40:35 on dist-test-slave-9dgf"
server_key: "2209ca4b819cf67484aa2d3a36f3acc7"
server_key_iv: "3b11bcbd180b5a383fda6e7e7bd373c5"
server_key_version: "encryptionkey@0"
I20260619 04:40:35.064670 20225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:35.070003 20225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:35.070787 20225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:35.071027 20225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:35.071893 20225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:35.073159 20225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:35.073252 20225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:35.073331 20225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:35.073378 20225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:35.104828 20225 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:41753
I20260619 04:40:35.104887 20351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:41753 every 8 connection(s)
I20260619 04:40:35.106307 20225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:40:35.112017 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 20225
I20260619 04:40:35.112213 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:40:35.112609 10113 external_mini_cluster.cc:1428] Setting key 0823e061abb6dc5eae8007101cd986ed
I20260619 04:40:35.115228 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:35.108981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:57231 (local address 127.9.224.126:45073)
0619 04:40:35.109169 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:35.109174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:35.110838 (+ 1664us) server_negotiation.cc:407] Connection header received
0619 04:40:35.112694 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:35.112699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:35.112769 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:35.112887 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:35.114453 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:35.114459 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:35.114465 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:35.114487 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:35.114528 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:35.114540 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:35.114662 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:35.114868 (+ 206us) server_negotiation.cc:299] Negotiation successful
0619 04:40:35.114934 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 04:40:35.116109 20354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:35.109539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45073 (local address 127.9.224.67:57231)
0619 04:40:35.110647 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:35.110691 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:35.112420 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:35.113194 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:35.113207 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:35.113337 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:35.114080 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:40:35.114083 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:35.114135 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:40:35.114295 (+ 160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:35.114640 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:35.114652 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:35.114659 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 04:40:35.114934 (+ 275us) client_negotiation.cc:240] Negotiation successful
0619 04:40:35.115185 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":252,"threads_started":1}
I20260619 04:40:35.117257 20352 heartbeater.cc:347] Connected to a master server at 127.9.224.126:45073
I20260619 04:40:35.117534 20352 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:35.118079 20352 heartbeater.cc:511] Master 127.9.224.126:45073 requested a full tablet report, sending...
I20260619 04:40:35.119439 19905 ts_manager.cc:194] Registered new tserver with Master: 0b9a40ce831d4695af047f08eba6a546 (127.9.224.67:41753)
I20260619 04:40:35.128077 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 04:40:35.134389 20093 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:40:35.132656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52304 (local address 127.9.224.126:45073)
0619 04:40:35.132918 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:35.132922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:35.133392 (+ 470us) server_negotiation.cc:407] Connection header received
0619 04:40:35.133529 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:35.133533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:35.133587 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:35.133674 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:35.134071 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52304: BlockingRecv error: recv got EOF from 127.0.0.1:52304 (error 108)
Metrics: {"server-negotiator.queue_time_us":133}
I20260619 04:40:35.135373 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19964
I20260619 04:40:35.138890 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:35.136273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52072 (local address 127.9.224.65:32795)
0619 04:40:35.136758 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:35.136765 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:35.136790 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:40:35.136847 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:35.136853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:35.137074 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:35.137206 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:35.138199 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:35.138206 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:35.138273 (+ 67us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:35.138291 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:35.138344 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:35.138364 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:35.138469 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:35.138593 (+ 124us) server_negotiation.cc:299] Negotiation successful
0619 04:40:35.138677 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":226,"threads_started":1}
I20260619 04:40:35.140117 20086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:35.220769 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19964
I20260619 04:40:35.237650 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 20095
I20260619 04:40:35.241278 20363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:35.238642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49576 (local address 127.9.224.66:39709)
0619 04:40:35.239123 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:35.239130 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:35.239155 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:40:35.239216 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:35.239222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:35.239434 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:35.239602 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:35.240592 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:35.240599 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:35.240610 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:35.240627 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:35.240666 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:35.240680 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:35.240835 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:35.240918 (+ 83us) server_negotiation.cc:299] Negotiation successful
0619 04:40:35.241021 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":227,"threads_started":1}
I20260619 04:40:35.242744 20217 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:35.322304 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 20095
I20260619 04:40:35.337940 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 20225
I20260619 04:40:35.341593 20365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:35.338928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.9.224.67:41753)
0619 04:40:35.339613 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:35.339620 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:35.339650 (+ 30us) server_negotiation.cc:407] Connection header received
0619 04:40:35.339708 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:35.339714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:35.339932 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:35.340056 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:35.340956 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:35.340962 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:35.340973 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:40:35.340989 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:35.341027 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:40:35.341040 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:35.341171 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:35.341220 (+ 49us) server_negotiation.cc:299] Negotiation successful
0619 04:40:35.341295 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":347,"threads_started":1}
I20260619 04:40:35.343081 20347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:35.425069 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 20225
I20260619 04:40:35.440887 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 19874
I20260619 04:40:35.442111 19935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:35.543026 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 19874
2026-06-19T04:40:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2371 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:40:35 dist-test-slave-9dgf krb5kdc[20370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:40:35 dist-test-slave-9dgf krb5kdc[20370](info): set up 2 sockets
Jun 19 04:40:35 dist-test-slave-9dgf krb5kdc[20370](info): commencing operation
krb5kdc: starting...
W20260619 04:40:36.651247 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.005s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:40:36 dist-test-slave-9dgf krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:40:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:40:36.885588 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:35545
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:34661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:35545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:37.212158 20383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:37.212476 20383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:37.212654 20383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:37.219950 20383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:40:37.220067 20383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:37.220183 20383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:37.220290 20383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:40:37.220373 20383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:40:37.230365 20383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:34661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:35545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:35545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:37.231775 20383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:37.233156 20383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:37.244851 20388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:37.244918 20389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:37.244896 20391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:37.245837 20383 server_base.cc:1034] running on GCE node
I20260619 04:40:37.246717 20383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:37.248157 20383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:37.249385 20383 hybrid_clock.cc:648] HybridClock initialized: now 1781844037249348 us; error 49 us; skew 500 ppm
I20260619 04:40:37.249728 20383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:37 dist-test-slave-9dgf krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844037, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:37.257444 20383 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:40:37.258960 20383 webserver.cc:460] Webserver started at http://127.9.224.126:35031/ using document root <none> and password file <none>
I20260619 04:40:37.259593 20383 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:37.259689 20383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:37.259925 20383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:37.262830 20383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "0b3806ae7ebb452891db4d9647898d26"
format_stamp: "Formatted at 2026-06-19 04:40:37 on dist-test-slave-9dgf"
server_key: "51b2c7cb8dee18bc0a06baaaa1a6a176"
server_key_iv: "28ca9c5dd02c1d2d7ffbf7ecec8eb0fa"
server_key_version: "encryptionkey@0"
I20260619 04:40:37.263515 20383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "0b3806ae7ebb452891db4d9647898d26"
format_stamp: "Formatted at 2026-06-19 04:40:37 on dist-test-slave-9dgf"
server_key: "51b2c7cb8dee18bc0a06baaaa1a6a176"
server_key_iv: "28ca9c5dd02c1d2d7ffbf7ecec8eb0fa"
server_key_version: "encryptionkey@0"
I20260619 04:40:37.268450 20383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:40:37.271767 20398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:37.273078 20383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260619 04:40:37.273216 20383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "0b3806ae7ebb452891db4d9647898d26"
format_stamp: "Formatted at 2026-06-19 04:40:37 on dist-test-slave-9dgf"
server_key: "51b2c7cb8dee18bc0a06baaaa1a6a176"
server_key_iv: "28ca9c5dd02c1d2d7ffbf7ecec8eb0fa"
server_key_version: "encryptionkey@0"
I20260619 04:40:37.273383 20383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:37.288717 20383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:37.292673 20383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:37.292904 20383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:37.310926 20383 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:35545
I20260619 04:40:37.310951 20449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:35545 every 8 connection(s)
I20260619 04:40:37.312337 20383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:40:37.315959 20450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:37.318691 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 20383
I20260619 04:40:37.318912 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:40:37.319701 10113 external_mini_cluster.cc:1428] Setting key 7b98ede1a7c43296202c90808b8c8b5c
I20260619 04:40:37.328477 20450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26: Bootstrap starting.
I20260619 04:40:37.332244 20450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:37.333575 20450 log.cc:824] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26: Log is configured to *not* fsync() on all Append() calls
Jun 19 04:40:37 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:37.336393 20450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26: No bootstrap required, opened a new log
I20260619 04:40:37.342551 20453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:37.321760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55214 (local address 127.9.224.126:35545)
0619 04:40:37.322535 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:37.322547 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:37.322584 (+ 37us) server_negotiation.cc:407] Connection header received
0619 04:40:37.324200 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:37.324222 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:37.324620 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:37.324950 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:37.326752 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:37.327986 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:37.329710 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:37.330426 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:37.330555 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:37.335336 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:37.335345 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:37.335358 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:37.335391 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:37.338461 (+ 3070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:37.339174 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:37.339189 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:37.339195 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:37.339364 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:37.339747 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:37.339754 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:37.339757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:37.340263 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:37.340615 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:37.341004 (+ 389us) server_negotiation.cc:299] Negotiation successful
0619 04:40:37.341417 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":350,"threads_started":1}
I20260619 04:40:37.344853 20450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b3806ae7ebb452891db4d9647898d26" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35545 } }
I20260619 04:40:37.345229 20450 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:37.345358 20450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b3806ae7ebb452891db4d9647898d26, State: Initialized, Role: FOLLOWER
I20260619 04:40:37.345958 20450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b3806ae7ebb452891db4d9647898d26" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35545 } }
I20260619 04:40:37.346151 20450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:40:37.346338 20450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:40:37.346472 20450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:37.348903 20450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b3806ae7ebb452891db4d9647898d26" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35545 } }
I20260619 04:40:37.349342 20450 leader_election.cc:302] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b3806ae7ebb452891db4d9647898d26; no voters:
I20260619 04:40:37.349887 20450 leader_election.cc:288] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:40:37.350051 20455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:37.350781 20455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [term 1 LEADER]: Becoming Leader. State: Replica: 0b3806ae7ebb452891db4d9647898d26, State: Running, Role: LEADER
I20260619 04:40:37.351334 20455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b3806ae7ebb452891db4d9647898d26" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35545 } }
I20260619 04:40:37.351956 20450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:40:37.354081 20457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b3806ae7ebb452891db4d9647898d26. Latest consensus state: current_term: 1 leader_uuid: "0b3806ae7ebb452891db4d9647898d26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b3806ae7ebb452891db4d9647898d26" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35545 } } }
I20260619 04:40:37.354456 20457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:37.355064 20456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b3806ae7ebb452891db4d9647898d26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b3806ae7ebb452891db4d9647898d26" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35545 } } }
I20260619 04:40:37.355504 20456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26 [sys.catalog]: This master's current role is: LEADER
I20260619 04:40:37.357805 20462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:40:37.363293 20462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:40:37.372934 20462 catalog_manager.cc:1347] Generated new cluster ID: cb65c515ea3f4bb2b9a95468d78356db
I20260619 04:40:37.373118 20462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:40:37.395900 20462 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:40:37.397632 20462 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:40:37.410064 20462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26: Generated new TSK 0
I20260619 04:40:37.411139 20462 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:40:37.486610 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:35545
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:34661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:37.834748 20476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:37.835059 20476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:37.835224 20476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:37.843220 20476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:37.843322 20476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:37.843540 20476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:40:37.853847 20476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:34661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:35545
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:37.855228 20476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:37.856716 20476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:37.870579 20481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:37.870527 20484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:37.870491 20482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:37.871631 20476 server_base.cc:1034] running on GCE node
I20260619 04:40:37.872319 20476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:37.873292 20476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:37.874529 20476 hybrid_clock.cc:648] HybridClock initialized: now 1781844037874478 us; error 58 us; skew 500 ppm
I20260619 04:40:37.874857 20476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:37 dist-test-slave-9dgf krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844037, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:37.878352 20476 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:40:37.879914 20476 webserver.cc:460] Webserver started at http://127.9.224.65:43633/ using document root <none> and password file <none>
I20260619 04:40:37.880584 20476 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:37.880688 20476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:37.880931 20476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:37.883917 20476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "765a6c8e0e4e4d94a6e416cfdedef69e"
format_stamp: "Formatted at 2026-06-19 04:40:37 on dist-test-slave-9dgf"
server_key: "ab210a274ff8db115b74f1e79ea63363"
server_key_iv: "1efac14fd3c93bf5133339367838521a"
server_key_version: "encryptionkey@0"
I20260619 04:40:37.884687 20476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "765a6c8e0e4e4d94a6e416cfdedef69e"
format_stamp: "Formatted at 2026-06-19 04:40:37 on dist-test-slave-9dgf"
server_key: "ab210a274ff8db115b74f1e79ea63363"
server_key_iv: "1efac14fd3c93bf5133339367838521a"
server_key_version: "encryptionkey@0"
I20260619 04:40:37.890096 20476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260619 04:40:37.893793 20491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:37.895529 20476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:40:37.895707 20476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "765a6c8e0e4e4d94a6e416cfdedef69e"
format_stamp: "Formatted at 2026-06-19 04:40:37 on dist-test-slave-9dgf"
server_key: "ab210a274ff8db115b74f1e79ea63363"
server_key_iv: "1efac14fd3c93bf5133339367838521a"
server_key_version: "encryptionkey@0"
I20260619 04:40:37.895901 20476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:37.917570 20476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:37.921892 20476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:37.922204 20476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:37.923308 20476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:37.924628 20476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:37.924706 20476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:37.924852 20476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:37.924918 20476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:37.959030 20476 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:33091
I20260619 04:40:37.959120 20603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:33091 every 8 connection(s)
I20260619 04:40:37.960319 20476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:40:37.963663 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 20476
I20260619 04:40:37.963914 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:40:37.964716 10113 external_mini_cluster.cc:1428] Setting key 810b200d65d2f13b715edbcdb48c1949
Jun 19 04:40:37 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844037, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:37.984243 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:37.962817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:36377 (local address 127.9.224.126:35545)
0619 04:40:37.963293 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:37.963297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:37.964453 (+ 1156us) server_negotiation.cc:407] Connection header received
0619 04:40:37.966518 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:37.966523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:37.966599 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:37.966718 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:37.968908 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:37.969630 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:37.972091 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:37.972504 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:37.972602 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:37.977113 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:37.977122 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:37.977130 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:37.977185 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:37.980796 (+ 3611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:37.981612 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:37.981621 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:37.981628 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:37.981782 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:37.982381 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:37.982385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:37.982387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:37.982688 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:37.982870 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:37.983633 (+ 763us) server_negotiation.cc:299] Negotiation successful
0619 04:40:37.983868 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":251,"threads_started":1}
I20260619 04:40:37.985280 20607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:37.963522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:35545 (local address 127.9.224.65:36377)
0619 04:40:37.964294 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:37.964337 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:37.966190 (+ 1853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:37.967014 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:37.967034 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:37.967831 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:37.968710 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:37.968746 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:37.969795 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:37.969803 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:37.971923 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:37.971941 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:37.972743 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:37.972752 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:37.973077 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:37.973942 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:37.973978 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:37.976868 (+ 2890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:37.980953 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:37.980960 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:37.980975 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:37.981443 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:37.981945 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:37.981950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:37.981952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:37.982169 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:37.982842 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:37.982851 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:37.983228 (+ 377us) client_negotiation.cc:769] Sending connection context
0619 04:40:37.983514 (+ 286us) client_negotiation.cc:240] Negotiation successful
0619 04:40:37.984090 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":308,"threads_started":1}
I20260619 04:40:37.987049 20604 heartbeater.cc:347] Connected to a master server at 127.9.224.126:35545
I20260619 04:40:37.987371 20604 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:37.988095 20604 heartbeater.cc:511] Master 127.9.224.126:35545 requested a full tablet report, sending...
I20260619 04:40:37.990533 20415 ts_manager.cc:194] Registered new tserver with Master: 765a6c8e0e4e4d94a6e416cfdedef69e (127.9.224.65:33091)
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:40:37.992095 20415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:36377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:40:38.021433 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:35545
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:34661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:38.344550 20610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:38.344820 20610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:38.345008 20610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:38.353557 20610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:38.353685 20610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:38.353870 20610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:40:38.363837 20610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:34661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:35545
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:38.365181 20610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:38.366557 20610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:38.379690 20618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:38.379762 20616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:38.379721 20615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:38.380595 20610 server_base.cc:1034] running on GCE node
I20260619 04:40:38.381160 20610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:38.382056 20610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:38.383283 20610 hybrid_clock.cc:648] HybridClock initialized: now 1781844038383231 us; error 70 us; skew 500 ppm
I20260619 04:40:38.383694 20610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:38 dist-test-slave-9dgf krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844038, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:38.386831 20610 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:40:38.388299 20610 webserver.cc:460] Webserver started at http://127.9.224.66:36663/ using document root <none> and password file <none>
I20260619 04:40:38.388999 20610 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:38.389142 20610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:38.389448 20610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:38.392395 20610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "65e914b7c3ac4514bf1cd366ab273d01"
format_stamp: "Formatted at 2026-06-19 04:40:38 on dist-test-slave-9dgf"
server_key: "a9d7be8a1404b9f67329e07e022ac16c"
server_key_iv: "71103850c0e1c16a74ed98462bcd5abf"
server_key_version: "encryptionkey@0"
I20260619 04:40:38.393225 20610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "65e914b7c3ac4514bf1cd366ab273d01"
format_stamp: "Formatted at 2026-06-19 04:40:38 on dist-test-slave-9dgf"
server_key: "a9d7be8a1404b9f67329e07e022ac16c"
server_key_iv: "71103850c0e1c16a74ed98462bcd5abf"
server_key_version: "encryptionkey@0"
I20260619 04:40:38.398666 20610 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 04:40:38.402413 20625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:38.403760 20610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:40:38.403954 20610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "65e914b7c3ac4514bf1cd366ab273d01"
format_stamp: "Formatted at 2026-06-19 04:40:38 on dist-test-slave-9dgf"
server_key: "a9d7be8a1404b9f67329e07e022ac16c"
server_key_iv: "71103850c0e1c16a74ed98462bcd5abf"
server_key_version: "encryptionkey@0"
I20260619 04:40:38.404155 20610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:38.424037 20610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:38.428223 20610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:38.428540 20610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:38.429504 20610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:38.430946 20610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:38.431052 20610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:38.431211 20610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:38.431284 20610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:38.464164 20610 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:40317
I20260619 04:40:38.464216 20737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:40317 every 8 connection(s)
I20260619 04:40:38.465441 20610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:40:38.475198 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 20610
I20260619 04:40:38.475400 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:40:38.475816 10113 external_mini_cluster.cc:1428] Setting key 83fd94a03e2e93dc5903ca542800eb46
Jun 19 04:40:38 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844038, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:38.485395 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:38.468030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:41393 (local address 127.9.224.126:35545)
0619 04:40:38.468202 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:38.468206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:38.469371 (+ 1165us) server_negotiation.cc:407] Connection header received
0619 04:40:38.471237 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:38.471243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:38.471336 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:38.471447 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:38.472973 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.473667 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.475248 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.475762 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.475890 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:38.479677 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:38.479682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:38.479685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:38.479715 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:38.482429 (+ 2714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:38.483178 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:38.483188 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:38.483190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:38.483308 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:38.483754 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:38.483758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:38.483762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:38.484028 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:38.484204 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:38.484968 (+ 764us) server_negotiation.cc:299] Negotiation successful
0619 04:40:38.485159 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:40:38.486888 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:38.468552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:35545 (local address 127.9.224.66:41393)
0619 04:40:38.469215 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:38.469259 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:38.470973 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:38.471689 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:38.471697 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:38.472191 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:38.472755 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:38.472772 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.473808 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.473819 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:38.475111 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:38.475123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.475989 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.475996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:38.476260 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:38.476981 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:38.477009 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:38.479465 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:38.482570 (+ 3105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:38.482580 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:38.482597 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:38.483052 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:38.483443 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:38.483448 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:38.483451 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:38.483638 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:38.484157 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:38.484166 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:38.484536 (+ 370us) client_negotiation.cc:769] Sending connection context
0619 04:40:38.484837 (+ 301us) client_negotiation.cc:240] Negotiation successful
0619 04:40:38.485474 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":262,"threads_started":1}
I20260619 04:40:38.488399 20738 heartbeater.cc:347] Connected to a master server at 127.9.224.126:35545
I20260619 04:40:38.488742 20738 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:38.489494 20738 heartbeater.cc:511] Master 127.9.224.126:35545 requested a full tablet report, sending...
I20260619 04:40:38.491000 20415 ts_manager.cc:194] Registered new tserver with Master: 65e914b7c3ac4514bf1cd366ab273d01 (127.9.224.66:40317)
I20260619 04:40:38.491822 20415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:41393
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:40:38.529318 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:35545
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:34661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:40:38.857316 20743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:40:38.857651 20743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:40:38.857760 20743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:40:38.864913 20743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:40:38.865020 20743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:40:38.865130 20743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:40:38.874750 20743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:34661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:35545
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:40:38.876020 20743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:40:38.877591 20743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:40:38.890728 20749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:38.890789 20751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:40:38.890753 20748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:40:38.891887 20743 server_base.cc:1034] running on GCE node
I20260619 04:40:38.892494 20743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:40:38.893425 20743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:40:38.894615 20743 hybrid_clock.cc:648] HybridClock initialized: now 1781844038894554 us; error 50 us; skew 500 ppm
I20260619 04:40:38.894948 20743 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:40:38 dist-test-slave-9dgf krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844038, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:40:38.897917 20743 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:40:38.899490 20743 webserver.cc:460] Webserver started at http://127.9.224.67:45077/ using document root <none> and password file <none>
I20260619 04:40:38.900303 20743 fs_manager.cc:359] Metadata directory not provided
I20260619 04:40:38.900440 20743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:40:38.900764 20743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:40:38.903646 20743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "f534f4750bb546e6932e29c50dafdd4c"
format_stamp: "Formatted at 2026-06-19 04:40:38 on dist-test-slave-9dgf"
server_key: "e2f16e145110964a7e7efa30f240dfc5"
server_key_iv: "47f51bafd731da0fcf89434c8946f955"
server_key_version: "encryptionkey@0"
I20260619 04:40:38.904350 20743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "f534f4750bb546e6932e29c50dafdd4c"
format_stamp: "Formatted at 2026-06-19 04:40:38 on dist-test-slave-9dgf"
server_key: "e2f16e145110964a7e7efa30f240dfc5"
server_key_iv: "47f51bafd731da0fcf89434c8946f955"
server_key_version: "encryptionkey@0"
I20260619 04:40:38.909629 20743 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:40:38.913058 20758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:38.914471 20743 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:40:38.914638 20743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "f534f4750bb546e6932e29c50dafdd4c"
format_stamp: "Formatted at 2026-06-19 04:40:38 on dist-test-slave-9dgf"
server_key: "e2f16e145110964a7e7efa30f240dfc5"
server_key_iv: "47f51bafd731da0fcf89434c8946f955"
server_key_version: "encryptionkey@0"
I20260619 04:40:38.914849 20743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:40:38.945598 20743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:40:38.949687 20743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:40:38.949992 20743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:40:38.951073 20743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:40:38.952555 20743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:40:38.952651 20743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:38.952802 20743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:40:38.952879 20743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:40:38.986850 20743 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:41773
I20260619 04:40:38.986908 20870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:41773 every 8 connection(s)
I20260619 04:40:38.988178 20743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:40:38.991750 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 20743
I20260619 04:40:38.991964 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:40:38.992424 10113 external_mini_cluster.cc:1428] Setting key c8db443e7b3abc605454d01ad86af5ef
I20260619 04:40:38.995203 20604 heartbeater.cc:503] Master 127.9.224.126:35545 was elected leader, sending a full tablet report...
Jun 19 04:40:38 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844038, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:40:39.008656 20873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:38.990907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:44513 (local address 127.9.224.126:35545)
0619 04:40:38.991347 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:38.991352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:38.992497 (+ 1145us) server_negotiation.cc:407] Connection header received
0619 04:40:38.994741 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:38.994745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:38.994817 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:38.994931 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:38.996764 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.997560 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.999118 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.999521 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.999619 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.002893 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:39.002897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:39.002900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:39.002932 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:39.005518 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.006164 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.006171 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.006176 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.006382 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.006815 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.006821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.006824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.007200 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:39.007372 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.008072 (+ 700us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.008288 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":231,"threads_started":1}
I20260619 04:40:39.009577 20874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:38.991495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:35545 (local address 127.9.224.67:44513)
0619 04:40:38.992319 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:38.992372 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:38.994320 (+ 1948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:38.995173 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:38.995181 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:38.995906 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:40:38.996554 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:38.996599 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.997697 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.997700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:38.998995 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:38.999006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:38.999748 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:38.999753 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:38.999948 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.000550 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:40:39.000572 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:40:39.002705 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:40:39.005636 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:39.005643 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:39.005655 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:39.006036 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:39.006494 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:40:39.006499 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:40:39.006503 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:40:39.006687 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:40:39.007329 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:40:39.007394 (+ 65us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:40:39.007719 (+ 325us) client_negotiation.cc:769] Sending connection context
0619 04:40:39.007978 (+ 259us) client_negotiation.cc:240] Negotiation successful
0619 04:40:39.008521 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":382,"threads_started":1}
I20260619 04:40:39.010918 20871 heartbeater.cc:347] Connected to a master server at 127.9.224.126:35545
I20260619 04:40:39.011217 20871 heartbeater.cc:464] Registering TS with master...
I20260619 04:40:39.011941 20871 heartbeater.cc:511] Master 127.9.224.126:35545 requested a full tablet report, sending...
I20260619 04:40:39.013262 20415 ts_manager.cc:194] Registered new tserver with Master: f534f4750bb546e6932e29c50dafdd4c (127.9.224.67:41773)
I20260619 04:40:39.014091 20415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:44513
I20260619 04:40:39.020606 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:40:39.036959 20873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.025237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55216 (local address 127.9.224.126:35545)
0619 04:40:39.025406 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.025410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.025857 (+ 447us) server_negotiation.cc:407] Connection header received
0619 04:40:39.025968 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.025971 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.026028 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.026103 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:39.027485 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.028187 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.029340 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.029725 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.029810 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.032058 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:39.032063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:39.032066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:39.032093 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:39.034520 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.035190 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.035194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.035196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.035302 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.035656 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.035659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.035661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.035964 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:39.036140 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.036471 (+ 331us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.036624 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 04:40:39.041107 20415 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:40:39.047901 20415 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:40:39.070266 20884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.060136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:33091 (local address 127.0.0.1:35916)
0619 04:40:39.061181 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:39.061225 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:39.061445 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:39.062807 (+ 1362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:39.062816 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:39.062851 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:39.063205 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.063216 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.064647 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.064655 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.067236 (+ 2581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.067251 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.069060 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.069066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.069373 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.069429 (+ 56us) client_negotiation.cc:769] Sending connection context
0619 04:40:39.069565 (+ 136us) client_negotiation.cc:240] Negotiation successful
0619 04:40:39.069769 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":76,"thread_start_us":524,"threads_started":1}
I20260619 04:40:39.071310 20886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.060456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35916 (local address 127.9.224.65:33091)
0619 04:40:39.062122 (+ 1666us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.062129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.062151 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:40:39.062276 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.062284 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.062549 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.063384 (+ 835us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:39.063554 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.064516 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.067434 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.068845 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.068988 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.069205 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.070751 (+ 1546us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.070963 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1520,"thread_start_us":1359,"threads_started":1}
I20260619 04:40:39.073581 20888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.060344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40317 (local address 127.0.0.1:52758)
0619 04:40:39.065116 (+ 4772us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:39.065135 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:39.065238 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:39.066672 (+ 1434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:39.066678 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:39.066724 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:39.067185 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.067195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.068692 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.068700 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.071026 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.071041 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.072747 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.072753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.072914 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.072948 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 04:40:39.073054 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 04:40:39.073183 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4628,"mutex_wait_us":66,"spinlock_wait_cycles":896,"thread_start_us":6063,"threads_started":1}
I20260619 04:40:39.074396 20887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.060895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.9.224.66:40317)
0619 04:40:39.065460 (+ 4565us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.065472 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.065506 (+ 34us) server_negotiation.cc:407] Connection header received
0619 04:40:39.065617 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.065627 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.065910 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.066128 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:39.067360 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.068566 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.071213 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.072540 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.072693 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.072893 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.073108 (+ 215us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.073287 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4369,"thread_start_us":4246,"threads_started":1}
I20260619 04:40:39.074935 20539 tablet_service.cc:1467] Processing CreateTablet for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 (DEFAULT_TABLE table=test-table [id=0822f14f0e2b4583a95c0d6a673f9c99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:39.076433 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.062087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.9.224.67:41773)
0619 04:40:39.062824 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.062831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.066774 (+ 3943us) server_negotiation.cc:407] Connection header received
0619 04:40:39.066991 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.066999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.067230 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.067408 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:39.067979 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.069671 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.073926 (+ 4255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.075322 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.075457 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.075675 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.075931 (+ 256us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.076085 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":900,"threads_started":1}
I20260619 04:40:39.076467 20885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.061460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:41773 (local address 127.0.0.1:33306)
0619 04:40:39.066672 (+ 5212us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:39.066689 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:39.066825 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:39.067391 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:39.067395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:39.067423 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:39.067808 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.067820 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.069876 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.069881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.072051 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.072066 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.075521 (+ 3455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.075525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.075695 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.075772 (+ 77us) client_negotiation.cc:769] Sending connection context
0619 04:40:39.075909 (+ 137us) client_negotiation.cc:240] Negotiation successful
0619 04:40:39.076043 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5084,"mutex_wait_us":21,"spinlock_wait_cycles":1280,"thread_start_us":3362,"threads_started":1}
I20260619 04:40:39.076529 20539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:39.079275 20673 tablet_service.cc:1467] Processing CreateTablet for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 (DEFAULT_TABLE table=test-table [id=0822f14f0e2b4583a95c0d6a673f9c99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:39.079941 20806 tablet_service.cc:1467] Processing CreateTablet for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 (DEFAULT_TABLE table=test-table [id=0822f14f0e2b4583a95c0d6a673f9c99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:40:39.080592 20673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:39.081012 20806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:40:39.092621 20890 tablet_bootstrap.cc:492] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Bootstrap starting.
I20260619 04:40:39.093246 20891 tablet_bootstrap.cc:492] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Bootstrap starting.
I20260619 04:40:39.094904 20892 tablet_bootstrap.cc:492] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Bootstrap starting.
I20260619 04:40:39.096221 20890 tablet_bootstrap.cc:654] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:39.097162 20891 tablet_bootstrap.cc:654] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:39.097254 20890 log.cc:824] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:39.098390 20891 log.cc:824] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:39.098569 20892 tablet_bootstrap.cc:654] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Neither blocks nor log segments found. Creating new log.
I20260619 04:40:39.099691 20892 log.cc:824] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Log is configured to *not* fsync() on all Append() calls
I20260619 04:40:39.100461 20890 tablet_bootstrap.cc:492] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: No bootstrap required, opened a new log
I20260619 04:40:39.100749 20890 ts_tablet_manager.cc:1397] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260619 04:40:39.102298 20891 tablet_bootstrap.cc:492] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: No bootstrap required, opened a new log
I20260619 04:40:39.102603 20891 ts_tablet_manager.cc:1397] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 04:40:39.108178 20890 raft_consensus.cc:348] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.108583 20890 raft_consensus.cc:374] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:39.108707 20892 tablet_bootstrap.cc:492] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: No bootstrap required, opened a new log
I20260619 04:40:39.108716 20890 raft_consensus.cc:729] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765a6c8e0e4e4d94a6e416cfdedef69e, State: Initialized, Role: FOLLOWER
I20260619 04:40:39.108968 20892 ts_tablet_manager.cc:1397] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20260619 04:40:39.109346 20890 consensus_queue.cc:260] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.111037 20890 ts_tablet_manager.cc:1428] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260619 04:40:39.113672 20891 raft_consensus.cc:348] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.114144 20891 raft_consensus.cc:374] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:39.114265 20891 raft_consensus.cc:729] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f534f4750bb546e6932e29c50dafdd4c, State: Initialized, Role: FOLLOWER
I20260619 04:40:39.114894 20891 consensus_queue.cc:260] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.116114 20871 heartbeater.cc:503] Master 127.9.224.126:35545 was elected leader, sending a full tablet report...
I20260619 04:40:39.116626 20891 ts_tablet_manager.cc:1428] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260619 04:40:39.119302 20892 raft_consensus.cc:348] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.119658 20892 raft_consensus.cc:374] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:40:39.119776 20892 raft_consensus.cc:729] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e914b7c3ac4514bf1cd366ab273d01, State: Initialized, Role: FOLLOWER
I20260619 04:40:39.120383 20892 consensus_queue.cc:260] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.121366 20738 heartbeater.cc:503] Master 127.9.224.126:35545 was elected leader, sending a full tablet report...
I20260619 04:40:39.122008 20892 ts_tablet_manager.cc:1428] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260619 04:40:39.212703 20605 tablet.cc:2369] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:40:39.217487 20739 tablet.cc:2369] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:40:39.239908 20872 tablet.cc:2369] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:40:39.290834 20897 raft_consensus.cc:482] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:40:39.291162 20897 raft_consensus.cc:504] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.292960 20897 leader_election.cc:288] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 765a6c8e0e4e4d94a6e416cfdedef69e (127.9.224.65:33091), 65e914b7c3ac4514bf1cd366ab273d01 (127.9.224.66:40317)
I20260619 04:40:39.298991 20874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.293174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:33091 (local address 127.9.224.67:60473)
0619 04:40:39.293378 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:39.293399 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:39.293522 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:39.294103 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:39.294106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:39.294128 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:39.294333 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.294348 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.295441 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.295447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.296754 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.296765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.298198 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.298204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.298395 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.298427 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 04:40:39.298520 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 04:40:39.298673 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":20}
I20260619 04:40:39.299233 20886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.293379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:60473 (local address 127.9.224.65:33091)
0619 04:40:39.293592 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.293601 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.293623 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:40:39.293708 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.293716 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.293820 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.293924 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:39.294486 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.295309 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.296923 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.297873 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.298026 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.298102 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.298873 (+ 771us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.299006 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:40:39.299605 20887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.293799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:48027 (local address 127.9.224.66:40317)
0619 04:40:39.294022 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.294028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.294259 (+ 231us) server_negotiation.cc:407] Connection header received
0619 04:40:39.294454 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.294460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.294524 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.294618 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:40:39.295111 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.295875 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.297531 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.298647 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.298819 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.298898 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.299209 (+ 311us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.299339 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 04:40:39.300181 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.293439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40317 (local address 127.9.224.67:48027)
0619 04:40:39.294142 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0619 04:40:39.294155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 04:40:39.294323 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:40:39.294629 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:40:39.294634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:40:39.294655 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:40:39.294956 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.294963 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.296021 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.296028 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.297385 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:40:39.297396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.298846 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.298852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:40:39.299008 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.299030 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 04:40:39.299790 (+ 760us) client_negotiation.cc:240] Negotiation successful
0619 04:40:39.299927 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":23,"thread_start_us":410,"threads_started":1}
I20260619 04:40:39.300233 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a308f2b0a0429f9cc1dff1b7fe9ab0" candidate_uuid: "f534f4750bb546e6932e29c50dafdd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" is_pre_election: true
I20260619 04:40:39.300886 20559 raft_consensus.cc:2454] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f534f4750bb546e6932e29c50dafdd4c in term 0.
I20260619 04:40:39.301208 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a308f2b0a0429f9cc1dff1b7fe9ab0" candidate_uuid: "f534f4750bb546e6932e29c50dafdd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e914b7c3ac4514bf1cd366ab273d01" is_pre_election: true
I20260619 04:40:39.301548 20762 leader_election.cc:302] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765a6c8e0e4e4d94a6e416cfdedef69e, f534f4750bb546e6932e29c50dafdd4c; no voters:
I20260619 04:40:39.301651 20693 raft_consensus.cc:2454] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f534f4750bb546e6932e29c50dafdd4c in term 0.
I20260619 04:40:39.301942 20897 raft_consensus.cc:2781] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:40:39.302088 20897 raft_consensus.cc:482] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:40:39.302201 20897 raft_consensus.cc:3037] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:39.304401 20897 raft_consensus.cc:504] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.304961 20897 leader_election.cc:288] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [CANDIDATE]: Term 1 election: Requested vote from peers 765a6c8e0e4e4d94a6e416cfdedef69e (127.9.224.65:33091), 65e914b7c3ac4514bf1cd366ab273d01 (127.9.224.66:40317)
I20260619 04:40:39.305457 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a308f2b0a0429f9cc1dff1b7fe9ab0" candidate_uuid: "f534f4750bb546e6932e29c50dafdd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e914b7c3ac4514bf1cd366ab273d01"
I20260619 04:40:39.305457 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a308f2b0a0429f9cc1dff1b7fe9ab0" candidate_uuid: "f534f4750bb546e6932e29c50dafdd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e"
I20260619 04:40:39.305684 20693 raft_consensus.cc:3037] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:39.305684 20559 raft_consensus.cc:3037] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:40:39.308902 20559 raft_consensus.cc:2454] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f534f4750bb546e6932e29c50dafdd4c in term 1.
I20260619 04:40:39.308903 20693 raft_consensus.cc:2454] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f534f4750bb546e6932e29c50dafdd4c in term 1.
I20260619 04:40:39.309309 20759 leader_election.cc:302] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e914b7c3ac4514bf1cd366ab273d01, f534f4750bb546e6932e29c50dafdd4c; no voters:
I20260619 04:40:39.309607 20897 raft_consensus.cc:2781] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:40:39.310061 20897 raft_consensus.cc:686] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 1 LEADER]: Becoming Leader. State: Replica: f534f4750bb546e6932e29c50dafdd4c, State: Running, Role: LEADER
I20260619 04:40:39.310668 20897 consensus_queue.cc:237] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } }
I20260619 04:40:39.316026 20414 catalog_manager.cc:5495] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c reported cstate change: term changed from 0 to 1, leader changed from <none> to f534f4750bb546e6932e29c50dafdd4c (127.9.224.67). New cstate: current_term: 1 leader_uuid: "f534f4750bb546e6932e29c50dafdd4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f534f4750bb546e6932e29c50dafdd4c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 41773 } health_report { overall_health: HEALTHY } } }
I20260619 04:40:39.368321 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.362920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.9.224.67:41773)
0619 04:40:39.363125 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.363132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.363151 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:40:39.363395 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.363399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.363473 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.363634 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:40:39.364001 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.364725 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.366075 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.366549 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.366687 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.367188 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:40:39.367706 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:40:39.367869 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.367967 (+ 98us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.368054 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:40:39.377486 20559 raft_consensus.cc:1261] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 1 FOLLOWER]: Refusing update from remote peer f534f4750bb546e6932e29c50dafdd4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:39.377488 20693 raft_consensus.cc:1261] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 1 FOLLOWER]: Refusing update from remote peer f534f4750bb546e6932e29c50dafdd4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:40:39.378600 20900 consensus_queue.cc:1035] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "765a6c8e0e4e4d94a6e416cfdedef69e" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:39.378959 20897 consensus_queue.cc:1035] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e914b7c3ac4514bf1cd366ab273d01" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:40:39.391505 20903 mvcc.cc:205] Tried to move back new op lower bound from 7298433185277501440 to 7298433185020121088. Current Snapshot: MvccSnapshot[applied={T|T < 7298433185277501440}]
I20260619 04:40:39.405787 20414 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:39.406100 20414 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:40:39.409869 20414 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b3806ae7ebb452891db4d9647898d26: Sending DeleteTablet for 3 replicas of tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0
I20260619 04:40:39.411259 20673 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:39 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:52758
I20260619 04:40:39.411254 20539 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:39 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:35916
I20260619 04:40:39.412626 20806 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:40:39 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:33306
I20260619 04:40:39.414575 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 20476
I20260619 04:40:39.430357 20915 tablet_replica.cc:330] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: stopping tablet replica
I20260619 04:40:39.430984 20915 raft_consensus.cc:2229] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:40:39.431581 20914 tablet_replica.cc:330] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: stopping tablet replica
I20260619 04:40:39.431723 20915 raft_consensus.cc:2258] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:39.432166 20914 raft_consensus.cc:2229] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:39.432750 20914 raft_consensus.cc:2258] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:39.434062 20915 ts_tablet_manager.cc:1905] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:39.437024 20914 ts_tablet_manager.cc:1905] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 04:40:39 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:40:39.440882 20913 tablet_replica.cc:330] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: stopping tablet replica
I20260619 04:40:39.441349 20913 raft_consensus.cc:2229] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:40:39.441848 20915 ts_tablet_manager.cc:1918] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:39.442027 20915 log.cc:1196] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b5a308f2b0a0429f9cc1dff1b7fe9ab0
I20260619 04:40:39.442026 20913 raft_consensus.cc:2258] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:40:39.442688 20915 ts_tablet_manager.cc:1939] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P f534f4750bb546e6932e29c50dafdd4c: Deleting consensus metadata
I20260619 04:40:39.444082 20913 ts_tablet_manager.cc:1905] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:40:39.444926 20402 catalog_manager.cc:4841] TS f534f4750bb546e6932e29c50dafdd4c (127.9.224.67:41773): tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 (table test-table [id=0822f14f0e2b4583a95c0d6a673f9c99]) successfully deleted
I20260619 04:40:39.447613 20914 ts_tablet_manager.cc:1918] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:39.447778 20914 log.cc:1196] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/b5a308f2b0a0429f9cc1dff1b7fe9ab0
I20260619 04:40:39.448338 20914 ts_tablet_manager.cc:1939] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 765a6c8e0e4e4d94a6e416cfdedef69e: Deleting consensus metadata
I20260619 04:40:39.450121 20402 catalog_manager.cc:4841] TS 765a6c8e0e4e4d94a6e416cfdedef69e (127.9.224.65:33091): tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 (table test-table [id=0822f14f0e2b4583a95c0d6a673f9c99]) successfully deleted
I20260619 04:40:39.451951 20913 ts_tablet_manager.cc:1918] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:40:39.452144 20913 log.cc:1196] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b5a308f2b0a0429f9cc1dff1b7fe9ab0
I20260619 04:40:39.452656 20913 ts_tablet_manager.cc:1939] T b5a308f2b0a0429f9cc1dff1b7fe9ab0 P 65e914b7c3ac4514bf1cd366ab273d01: Deleting consensus metadata
I20260619 04:40:39.454350 20886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.416345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35924 (local address 127.9.224.65:33091)
0619 04:40:39.416593 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.416603 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.420272 (+ 3669us) server_negotiation.cc:407] Connection header received
0619 04:40:39.421181 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.421190 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.421297 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.421387 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:39.425759 (+ 4372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.427301 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.432973 (+ 5672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.433628 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.433735 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.446592 (+ 12857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:39.446607 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:39.446624 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:39.446673 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:39.450758 (+ 4085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.451669 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.451680 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.451686 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.451867 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.452334 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.452342 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.452347 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.452915 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:39.453266 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.453533 (+ 267us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.453766 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 04:40:39.454650 20399 catalog_manager.cc:4841] TS 65e914b7c3ac4514bf1cd366ab273d01 (127.9.224.66:40317): tablet b5a308f2b0a0429f9cc1dff1b7fe9ab0 (table test-table [id=0822f14f0e2b4583a95c0d6a673f9c99]) successfully deleted
I20260619 04:40:39.455272 20599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:39.557530 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 20476
I20260619 04:40:39.574604 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 20610
Jun 19 04:40:39 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:40:39.592482 20887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.575704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.9.224.66:40317)
0619 04:40:39.576030 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.576039 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.576064 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:40:39.576359 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.576380 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.576479 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.576647 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:39.578207 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.579189 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.580671 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.581168 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.581325 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.586328 (+ 5003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:39.586348 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:39.586366 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:39.586413 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:39.589523 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.590303 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.590315 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.590321 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.590481 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.590880 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.590886 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.590890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.591289 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:39.591580 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.591909 (+ 329us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.592137 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260619 04:40:39.593201 20733 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:39.691009 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 20610
I20260619 04:40:39.708490 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 20743
Jun 19 04:40:39 dist-test-slave-9dgf krb5kdc[20370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:40:39.725944 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:40:39.709529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33322 (local address 127.9.224.67:41773)
0619 04:40:39.709734 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0619 04:40:39.709738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:40:39.709754 (+ 16us) server_negotiation.cc:407] Connection header received
0619 04:40:39.709806 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:40:39.709809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:40:39.709897 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:40:39.710000 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:40:39.711386 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.712211 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.713499 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:40:39.713958 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:40:39.714100 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:40:39.718757 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:40:39.718774 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:40:39.718823 (+ 49us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:40:39.718882 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:40:39.722969 (+ 4087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.723660 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.723675 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.723679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.723869 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:40:39.724227 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:40:39.724232 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:40:39.724235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:40:39.724739 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:40:39.725062 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 04:40:39.725274 (+ 212us) server_negotiation.cc:299] Negotiation successful
0619 04:40:39.725501 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:40:39.726914 20866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:39.855234 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 20743
I20260619 04:40:39.874626 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 20383
I20260619 04:40:39.875824 20445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:40:39.984434 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 20383
2026-06-19T04:40:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4443 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:40:40 dist-test-slave-9dgf krb5kdc[20923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:40:40 dist-test-slave-9dgf krb5kdc[20923](info): set up 2 sockets
Jun 19 04:40:40 dist-test-slave-9dgf krb5kdc[20923](info): commencing operation
krb5kdc: starting...
W20260619 04:40:41.119204 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:40:41 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:40:41Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/rangeradmin_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/rangeradmin_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/rangerlookup_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/rangerlookup_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
I20260619 04:40:41.453490 10113 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXgzdm0/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/postgres -l logfile start
2026-06-19 04:40:44.078 UTC [20953] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-19 04:40:44.078 UTC [20953] LOG: listening on IPv4 address "127.9.224.84", port 44043
2026-06-19 04:40:44.081 UTC [20953] LOG: listening on Unix socket "/tmp/.s.PGSQL.44043"
2026-06-19 04:40:44.106 UTC [20956] LOG: database system was shut down at 2026-06-19 04:40:42 UTC
2026-06-19 04:40:44.110 UTC [20953] LOG: database system is ready to accept connections
I20260619 04:40:45.094798 10113 mini_postgres.cc:96] Postgres bound to 44043
2026-06-19 04:40:45.112 UTC [20964] FATAL: database "slave" does not exist
127.9.224.84:44043 - accepting connections
I20260619 04:40:45.113009 10113 mini_ranger.cc:161] Starting Ranger...
I20260619 04:40:45.138803 10113 mini_ranger.cc:84] Created miniranger Postgres user
I20260619 04:40:45.639572 10113 mini_ranger.cc:87] Created ranger Postgres database
I20260619 04:40:45.639681 10113 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-admin
2026-06-19 04:40:45,956 [I] DB FLAVOR :POSTGRES
2026-06-19 04:40:45,957 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 04:40:45,957 [I] Checking connection..
2026-06-19 04:40:45,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-19 04:40:46,221 [I] Checking connection passed.
2026-06-19 04:40:46,221 [I] --------- Verifying version history table ---------
2026-06-19 04:40:46,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 04:40:46,487 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 04:40:46,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 04:40:46,753 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 04:40:46,753 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-19 04:40:46,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-19 04:40:46.999 UTC [21028] WARNING: there is no transaction in progress
2026-06-19 04:40:47,005 [I] create_dbversion_catalog.sql file imported successfully
2026-06-19 04:40:47,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 04:40:47,273 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-19 04:40:47,273 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 04:40:47,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-19 04:40:47,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-19 04:40:47,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-9dgf.c.gcp-upstream.internal','N') ;"
2026-06-19 04:40:48,018 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 04:40:48,260 [I] Table x_portal_user does not exist in database ranger
2026-06-19 04:40:48,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 04:40:48,513 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-19 04:40:48,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 04:40:48,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 04:40:49,006 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-19 04:40:49,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-19 04:40:50.066 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.083 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.102 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.118 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.135 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.153 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.214 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.221 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.237 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.248 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.259 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.273 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.284 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.292 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.299 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:50.307 UTC [21136] WARNING: there is no transaction in progress
2026-06-19 04:40:51,054 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-19 04:40:51,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-19 04:40:51,293 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-19 04:40:51,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 04:40:51,551 [I] Table x_portal_user already exists in database 'ranger'
2026-06-19 04:40:51,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 04:40:51,810 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-19 04:40:51,810 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 04:40:52,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 04:40:52,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-9dgf.c.gcp-upstream.internal';"
2026-06-19 04:40:52,596 [I] CORE_DB_SCHEMA import status has been updated
2026-06-19 04:40:52,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-19 04:40:52,858 [I] DB_PATCHES have already been applied
I20260619 04:40:52.864502 10113 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXgzdm0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260619 04:40:52.864638 10113 mini_ranger.cc:193] Using host: 127.9.224.84
I20260619 04:40:52.880534 10113 mini_ranger.cc:227] Ranger admin URL: http://127.9.224.84:56741
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp].
Jun 19, 2026 4:40:53 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260619 04:40:54.018182 10113 mini_ranger.cc:160] Time spent starting Ranger: real 8.905s user 0.000s sys 0.042s
Jun 19, 2026 4:41:13 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 19, 2026 4:41:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Jun 19, 2026 4:41:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 19, 2026 4:41:13 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 19, 2026 4:41:14 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260619 04:41:14.955329 10113 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/rangerkms_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/rangerkms_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.224.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.224.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 19 04:41:15 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844075, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260619 04:41:15.139552 10113 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260619 04:41:15.166043 10113 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260619 04:41:16.080353 10113 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260619 04:41:16.080566 10113 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms
I20260619 04:41:16.080708 10113 mini_ranger_kms.cc:227] Using postgres at 127.9.224.84:44043
2026-06-19 04:41:16,500 [I] DB FLAVOR :POSTGRES
2026-06-19 04:41:16,500 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 04:41:16,500 [I] Checking connection
2026-06-19 04:41:16,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-19 04:41:16,750 [I] connection success
2026-06-19 04:41:16,750 [I] --------- Verifying Ranger DB tables ---------
2026-06-19 04:41:16,750 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-19 04:41:16,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-19 04:41:16,992 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-19 04:41:16,992 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 04:41:16,993 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-19 04:41:16,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:44043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-19 04:41:17,251 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260619 04:41:17.720152 10113 mini_ranger_kms.cc:310] Created kms service
I20260619 04:41:17.913254 10113 mini_ranger_kms.cc:326] Created kudu user
I20260619 04:41:17.959800 10113 mini_ranger_kms.cc:343] Created rangerkms user
Jun 19 04:41:17 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844075, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:41:18.381315 10113 mini_ranger_kms.cc:384] Added ranger policy
I20260619 04:41:18.381640 10113 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260619 04:41:18.381703 10113 mini_ranger_kms.cc:240] Using host: 127.9.224.84
I20260619 04:41:18.404028 10113 mini_ranger_kms.cc:276] Ranger KMS PID: 21316
I20260619 04:41:18.404230 10113 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.224.84:42013
Jun 19, 2026 4:41:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 4:41:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 4:41:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 19, 2026 4:41:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 19, 2026 4:41:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-kms/ews/webapp].
Jun 19, 2026 4:41:20 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260619 04:41:20.743176 10113 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.604s user 0.142s sys 0.296s
I20260619 04:41:20.743470 10113 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260619 04:41:20.743698 10113 mini_ranger_kms.cc:401] 127.9.224.84:42013/kms/v1/keys
Jun 19 04:41:20 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781844080, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.224.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 19 04:41:21 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844080, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.224.84@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
Jun 19 04:41:21 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844080, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.224.84@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
Jun 19 04:41:24 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:41:24.284029 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34509
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:34509
--ranger_config_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:42013/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:41:24.612022 21367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:41:24.612308 21367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:41:24.612466 21367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:41:24.619629 21367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:41:24.619746 21367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:41:24.619850 21367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:41:24.619959 21367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:41:24.620024 21367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:41:24.630517 21367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.224.84:42013/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:34509
--ranger_config_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:41:24.631894 21367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:41:24.633210 21367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:41:24.645612 21373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:24.645596 21375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:24.645699 21372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:41:24.646247 21367 server_base.cc:1034] running on GCE node
I20260619 04:41:24.647109 21367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:41:24.648518 21367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:41:24.649767 21367 hybrid_clock.cc:648] HybridClock initialized: now 1781844084649697 us; error 65 us; skew 500 ppm
I20260619 04:41:24.650118 21367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:41:24 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:41:24.653544 21367 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:41:24.655100 21367 webserver.cc:460] Webserver started at http://127.9.224.126:35861/ using document root <none> and password file <none>
I20260619 04:41:24.655768 21367 fs_manager.cc:359] Metadata directory not provided
I20260619 04:41:24.655905 21367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:41:24.656198 21367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:41:24 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:41:24.718544 21367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "bcd56d760c6147ac968304c6ec138ba2"
format_stamp: "Formatted at 2026-06-19 04:41:24 on dist-test-slave-9dgf"
server_key: "94de12dd61f986acce41adce9ac6cc5a"
server_key_iv: "dbee214d45f2bc34e58b559420a74910"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:24.719450 21367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "bcd56d760c6147ac968304c6ec138ba2"
format_stamp: "Formatted at 2026-06-19 04:41:24 on dist-test-slave-9dgf"
server_key: "94de12dd61f986acce41adce9ac6cc5a"
server_key_iv: "dbee214d45f2bc34e58b559420a74910"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:24.725111 21367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260619 04:41:24.746944 21382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:24.748909 21367 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260619 04:41:24.749230 21367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "bcd56d760c6147ac968304c6ec138ba2"
format_stamp: "Formatted at 2026-06-19 04:41:24 on dist-test-slave-9dgf"
server_key: "94de12dd61f986acce41adce9ac6cc5a"
server_key_iv: "dbee214d45f2bc34e58b559420a74910"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:24.749512 21367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:41:24.774551 21367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:41:24.779693 21367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:41:24.780019 21367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:41:24.807582 21433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:34509 every 8 connection(s)
I20260619 04:41:24.807591 21367 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:34509
I20260619 04:41:24.809512 21367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:41:24.813629 21434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:41:24.817600 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 21367
I20260619 04:41:24.817826 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:41:24.818710 10113 external_mini_cluster.cc:1428] Setting key bef438f74bd3ac86e46b87e4b0ece670
I20260619 04:41:24.829399 21434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2: Bootstrap starting.
I20260619 04:41:24.834417 21434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2: Neither blocks nor log segments found. Creating new log.
I20260619 04:41:24.835615 21434 log.cc:824] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2: Log is configured to *not* fsync() on all Append() calls
I20260619 04:41:24.839079 21434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2: No bootstrap required, opened a new log
Jun 19 04:41:24 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:41:24.848848 21434 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd56d760c6147ac968304c6ec138ba2" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34509 } }
I20260619 04:41:24.849380 21434 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:41:24.849488 21434 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcd56d760c6147ac968304c6ec138ba2, State: Initialized, Role: FOLLOWER
I20260619 04:41:24.850158 21434 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd56d760c6147ac968304c6ec138ba2" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34509 } }
I20260619 04:41:24.850464 21434 raft_consensus.cc:388] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:41:24.850607 21434 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:41:24.850807 21434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:41:24.853046 21434 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd56d760c6147ac968304c6ec138ba2" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34509 } }
I20260619 04:41:24.853564 21434 leader_election.cc:302] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcd56d760c6147ac968304c6ec138ba2; no voters:
I20260619 04:41:24.854286 21434 leader_election.cc:288] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:41:24.854386 21439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:41:24.856024 21437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:24.820989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45242 (local address 127.9.224.126:34509)
0619 04:41:24.833909 (+ 12920us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:24.833921 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:24.833960 (+ 39us) server_negotiation.cc:407] Connection header received
0619 04:41:24.835959 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:24.835982 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:24.836559 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:24.837020 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:24.838655 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:24.840342 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:24.842349 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:24.843049 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:24.843198 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:24.847793 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:24.847804 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:24.847825 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:24.847871 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:24.851500 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:24.852209 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:24.852218 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:24.852226 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:24.852385 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:24.852765 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:24.852777 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:24.852780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:24.853351 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:24.853647 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:24.854141 (+ 494us) server_negotiation.cc:299] Negotiation successful
0619 04:41:24.854608 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12660,"thread_start_us":12424,"threads_started":1}
I20260619 04:41:24.856976 21439 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [term 1 LEADER]: Becoming Leader. State: Replica: bcd56d760c6147ac968304c6ec138ba2, State: Running, Role: LEADER
I20260619 04:41:24.857216 21434 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:41:24.857618 21439 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd56d760c6147ac968304c6ec138ba2" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34509 } }
I20260619 04:41:24.861804 21440 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcd56d760c6147ac968304c6ec138ba2. Latest consensus state: current_term: 1 leader_uuid: "bcd56d760c6147ac968304c6ec138ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd56d760c6147ac968304c6ec138ba2" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34509 } } }
I20260619 04:41:24.862205 21440 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [sys.catalog]: This master's current role is: LEADER
I20260619 04:41:24.862426 21441 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcd56d760c6147ac968304c6ec138ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd56d760c6147ac968304c6ec138ba2" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34509 } } }
I20260619 04:41:24.862717 21441 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2 [sys.catalog]: This master's current role is: LEADER
I20260619 04:41:24.871381 21448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:41:24.871758 21434 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 04:41:24.882302 21448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:41:24.897244 21448 catalog_manager.cc:1347] Generated new cluster ID: 22eb6c95e4454269b5fbcd787148f2b8
I20260619 04:41:24.897410 21448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:41:24.911845 21448 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:41:24.913806 21448 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:41:24.924692 21448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2: Generated new TSK 0
I20260619 04:41:24.925765 21448 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:41:25.666570 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:42013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34509
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:41:25 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781844085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260619 04:41:26.085314 21479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:41:26.085798 21479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:41:26.086047 21479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:41:26.097762 21479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:41:26.097908 21479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:41:26.098093 21479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:41:26.114077 21479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.224.84:42013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:41:26.116010 21479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:41:26.117835 21479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:41:26.135489 21489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:26.136333 21490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:26.147966 21492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:41:26.148375 21479 server_base.cc:1034] running on GCE node
I20260619 04:41:26.149194 21479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:41:26.150907 21479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:41:26.152223 21479 hybrid_clock.cc:648] HybridClock initialized: now 1781844086152137 us; error 73 us; skew 500 ppm
I20260619 04:41:26.152601 21479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:41:26 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844086, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:41:26.160156 21479 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:41:26.168907 21479 webserver.cc:460] Webserver started at http://127.9.224.65:46217/ using document root <none> and password file <none>
I20260619 04:41:26.170033 21479 fs_manager.cc:359] Metadata directory not provided
I20260619 04:41:26.170290 21479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:41:26.170749 21479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:41:26 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844086, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:41:26.197981 21479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "6e18716e437b40519da305483558e79f"
format_stamp: "Formatted at 2026-06-19 04:41:26 on dist-test-slave-9dgf"
server_key: "1973bb02c205105958754a4e857793c9"
server_key_iv: "36e2d1c5a604819268f119e9ce3f9979"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:26.199296 21479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "6e18716e437b40519da305483558e79f"
format_stamp: "Formatted at 2026-06-19 04:41:26 on dist-test-slave-9dgf"
server_key: "1973bb02c205105958754a4e857793c9"
server_key_iv: "36e2d1c5a604819268f119e9ce3f9979"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:26.208388 21479 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.000s sys 0.007s
I20260619 04:41:26.255085 21499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:26.259351 21479 fs_manager.cc:725] Time spent opening block manager: real 0.031s user 0.005s sys 0.024s
I20260619 04:41:26.259644 21479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "6e18716e437b40519da305483558e79f"
format_stamp: "Formatted at 2026-06-19 04:41:26 on dist-test-slave-9dgf"
server_key: "1973bb02c205105958754a4e857793c9"
server_key_iv: "36e2d1c5a604819268f119e9ce3f9979"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:26.259989 21479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:41:26.316354 21479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:41:26.321288 21479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:41:26.321616 21479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:41:26.326756 21479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:41:26.328567 21479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:41:26.328683 21479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:26.328826 21479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:41:26.328912 21479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:41:26 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:41:26.409003 21479 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:40809
I20260619 04:41:26.409026 21611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:40809 every 8 connection(s)
I20260619 04:41:26.410789 21479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:41:26.418977 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 21479
I20260619 04:41:26.419209 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:41:26.420092 10113 external_mini_cluster.cc:1428] Setting key 33599128e82f3a73725f6064af5db9e3
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Jun 19 04:41:26 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844086, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:41:26.482851 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:26.418562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:58361 (local address 127.9.224.126:34509)
0619 04:41:26.445035 (+ 26473us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:26.445044 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:26.445069 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:41:26.445137 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:26.445144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:26.445246 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:26.445372 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:26.454078 (+ 8706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:26.455424 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:26.463361 (+ 7937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:26.464157 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:26.464321 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:26.471398 (+ 7077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:26.471407 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:26.471412 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:26.471458 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:26.475068 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:26.476134 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:26.476149 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:26.476153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:26.476305 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:26.476966 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:26.476971 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:26.476974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:26.477403 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:26.477539 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:26.478458 (+ 919us) server_negotiation.cc:299] Negotiation successful
0619 04:41:26.478772 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26328,"thread_start_us":26853,"threads_started":1}
I20260619 04:41:26.485563 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:26.417611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:34509 (local address 127.9.224.65:58361)
0619 04:41:26.435698 (+ 18087us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:26.435792 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:26.439436 (+ 3644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:26.450654 (+ 11218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:26.450692 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:26.451436 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:41:26.452430 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:26.452465 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:26.455732 (+ 3267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:26.455741 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:26.463096 (+ 7355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:26.463162 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:26.464698 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:26.464708 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:26.465071 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:26.466077 (+ 1006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:41:26.466131 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:41:26.471061 (+ 4930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:41:26.475304 (+ 4243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:41:26.475314 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:41:26.475334 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:41:26.475946 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:41:26.476512 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:41:26.476517 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:41:26.476521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:41:26.476829 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:41:26.477622 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:41:26.477628 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:41:26.477976 (+ 348us) client_negotiation.cc:769] Sending connection context
0619 04:41:26.483308 (+ 5332us) client_negotiation.cc:240] Negotiation successful
0619 04:41:26.483978 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14823,"thread_start_us":20506,"threads_started":1}
I20260619 04:41:26.487753 21612 heartbeater.cc:347] Connected to a master server at 127.9.224.126:34509
I20260619 04:41:26.488065 21612 heartbeater.cc:464] Registering TS with master...
I20260619 04:41:26.488925 21612 heartbeater.cc:511] Master 127.9.224.126:34509 requested a full tablet report, sending...
I20260619 04:41:26.491479 21399 ts_manager.cc:194] Registered new tserver with Master: 6e18716e437b40519da305483558e79f (127.9.224.65:40809)
I20260619 04:41:26.493786 21399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:58361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:41:26.514063 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:42013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34509
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:41:26 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844085, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
W20260619 04:41:26.963581 21618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:41:26.964030 21618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:41:26.964257 21618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:41:26.975982 21618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:41:26.976315 21618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:41:26.976574 21618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:41:26.993132 21618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.224.84:42013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:41:26.995242 21618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:41:26.997138 21618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:41:27.019307 21628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:27.019572 21626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:27.020036 21625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:41:27.020377 21618 server_base.cc:1034] running on GCE node
I20260619 04:41:27.021088 21618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:41:27.022188 21618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:41:27.023488 21618 hybrid_clock.cc:648] HybridClock initialized: now 1781844087023418 us; error 60 us; skew 500 ppm
I20260619 04:41:27.023847 21618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:41:27 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844087, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:41:27.027379 21618 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:41:27.031519 21618 webserver.cc:460] Webserver started at http://127.9.224.66:39031/ using document root <none> and password file <none>
I20260619 04:41:27.032295 21618 fs_manager.cc:359] Metadata directory not provided
I20260619 04:41:27.032449 21618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:41:27.032778 21618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:41:27 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844087, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:41:27.051641 21618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "71c8ef98bc454abe93b1b78b88bfdb7c"
format_stamp: "Formatted at 2026-06-19 04:41:27 on dist-test-slave-9dgf"
server_key: "a8c9304032fa6b2d3544941f49dc1fab"
server_key_iv: "3e45ee10fa1eaba307c8dd4574a53507"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:27.052726 21618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "71c8ef98bc454abe93b1b78b88bfdb7c"
format_stamp: "Formatted at 2026-06-19 04:41:27 on dist-test-slave-9dgf"
server_key: "a8c9304032fa6b2d3544941f49dc1fab"
server_key_iv: "3e45ee10fa1eaba307c8dd4574a53507"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:27.061332 21618 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260619 04:41:27.079820 21642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:27.081898 21618 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:41:27.082101 21618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "71c8ef98bc454abe93b1b78b88bfdb7c"
format_stamp: "Formatted at 2026-06-19 04:41:27 on dist-test-slave-9dgf"
server_key: "a8c9304032fa6b2d3544941f49dc1fab"
server_key_iv: "3e45ee10fa1eaba307c8dd4574a53507"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:27.082401 21618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:41:27.115504 21618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:41:27.119604 21618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:41:27.119911 21618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:41:27.120959 21618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:41:27.122509 21618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:41:27.122607 21618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:27.122751 21618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:41:27.122822 21618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:27.161435 21618 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:37763
I20260619 04:41:27.161468 21754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:37763 every 8 connection(s)
I20260619 04:41:27.162950 21618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:41:27.171660 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 21618
I20260619 04:41:27.171835 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:41:27.172385 10113 external_mini_cluster.cc:1428] Setting key 82e31a6a18d041071f6ebe3563f63581
Jun 19 04:41:27 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844087, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:41:27.184527 21757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.165652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:42663 (local address 127.9.224.126:34509)
0619 04:41:27.166172 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:27.166177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:27.167174 (+ 997us) server_negotiation.cc:407] Connection header received
0619 04:41:27.168893 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:27.168897 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:27.168977 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:27.169080 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:27.170582 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.171421 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.173576 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.174150 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.174321 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.178180 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:27.178186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:27.178189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:27.178274 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:27.181145 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:27.181888 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:27.181895 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:27.181899 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:27.182032 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:27.182609 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:27.182613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:27.182615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:27.182961 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:27.183097 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:27.184059 (+ 962us) server_negotiation.cc:299] Negotiation successful
0619 04:41:27.184248 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":232,"threads_started":1}
I20260619 04:41:27.186269 21758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.166300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:34509 (local address 127.9.224.66:42663)
0619 04:41:27.167005 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:27.167050 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:27.168645 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:27.169283 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:27.169290 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:27.169731 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:41:27.170438 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.170459 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.171556 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.171561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.173423 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.173448 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.174412 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.174423 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.174660 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.175447 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:41:27.175471 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:41:27.177920 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:41:27.181293 (+ 3373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:41:27.181303 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:41:27.181327 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:41:27.181761 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:41:27.182142 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:41:27.182147 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:41:27.182151 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:41:27.182456 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:41:27.183098 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:41:27.183110 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:41:27.183581 (+ 471us) client_negotiation.cc:769] Sending connection context
0619 04:41:27.183886 (+ 305us) client_negotiation.cc:240] Negotiation successful
0619 04:41:27.184471 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":278,"threads_started":1}
I20260619 04:41:27.188001 21755 heartbeater.cc:347] Connected to a master server at 127.9.224.126:34509
I20260619 04:41:27.188344 21755 heartbeater.cc:464] Registering TS with master...
I20260619 04:41:27.189265 21755 heartbeater.cc:511] Master 127.9.224.126:34509 requested a full tablet report, sending...
I20260619 04:41:27.191045 21399 ts_manager.cc:194] Registered new tserver with Master: 71c8ef98bc454abe93b1b78b88bfdb7c (127.9.224.66:37763)
I20260619 04:41:27.191871 21399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:42663
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:41:27.227665 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:42013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34509
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:41:27.497905 21612 heartbeater.cc:503] Master 127.9.224.126:34509 was elected leader, sending a full tablet report...
W20260619 04:41:27.557590 21761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:41:27.557868 21761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:41:27.558010 21761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:41:27.565552 21761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:41:27.565678 21761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:41:27.565867 21761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:41:27.575901 21761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.224.84:42013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:34509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:41:27.577210 21761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:41:27.578570 21761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:41:27.592296 21766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:27.592736 21767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:41:27.592739 21769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:41:27.593081 21761 server_base.cc:1034] running on GCE node
I20260619 04:41:27.593696 21761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:41:27.594712 21761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:41:27.595930 21761 hybrid_clock.cc:648] HybridClock initialized: now 1781844087595890 us; error 32 us; skew 500 ppm
I20260619 04:41:27.596284 21761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:41:27 dist-test-slave-9dgf krb5kdc[20923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844087, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:41:27.599637 21761 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:41:27.601107 21761 webserver.cc:460] Webserver started at http://127.9.224.67:46055/ using document root <none> and password file <none>
I20260619 04:41:27.601785 21761 fs_manager.cc:359] Metadata directory not provided
I20260619 04:41:27.601931 21761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:41:27.602283 21761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:41:27 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844087, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:41:27.616457 21761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "0ae646f9d6bc4bfbb978af7b010133da"
format_stamp: "Formatted at 2026-06-19 04:41:27 on dist-test-slave-9dgf"
server_key: "66ec690b357c1cad7f71b47a01bcfd8c"
server_key_iv: "3a90a987c9fa25c28cc1504e6aefca77"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:27.617340 21761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "0ae646f9d6bc4bfbb978af7b010133da"
format_stamp: "Formatted at 2026-06-19 04:41:27 on dist-test-slave-9dgf"
server_key: "66ec690b357c1cad7f71b47a01bcfd8c"
server_key_iv: "3a90a987c9fa25c28cc1504e6aefca77"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:27.623252 21761 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 04:41:27.638435 21776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:27.639950 21761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:41:27.640163 21761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "0ae646f9d6bc4bfbb978af7b010133da"
format_stamp: "Formatted at 2026-06-19 04:41:27 on dist-test-slave-9dgf"
server_key: "66ec690b357c1cad7f71b47a01bcfd8c"
server_key_iv: "3a90a987c9fa25c28cc1504e6aefca77"
server_key_version: "kuduclusterkey@0"
I20260619 04:41:27.640415 21761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:41:27.664470 21761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:41:27.668612 21761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:41:27.668869 21761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:41:27.669863 21761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:41:27.671252 21761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:41:27.671327 21761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:27.671407 21761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:41:27.671450 21761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:41:27.704564 21761 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:35527
I20260619 04:41:27.704605 21888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:35527 every 8 connection(s)
I20260619 04:41:27.705852 21761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:41:27.711244 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 21761
I20260619 04:41:27.711413 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:41:27.711867 10113 external_mini_cluster.cc:1428] Setting key 4cc643211f563687555b9e502b96d7a6
Jun 19 04:41:27 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844087, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:41:27.726190 21891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.708557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:39369 (local address 127.9.224.126:34509)
0619 04:41:27.709032 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:27.709036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:27.710071 (+ 1035us) server_negotiation.cc:407] Connection header received
0619 04:41:27.711945 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:27.711950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:27.712051 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:27.712174 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:27.713987 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.714987 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.716507 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.716944 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.717077 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.720261 (+ 3184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:27.720265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:27.720268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:27.720309 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:27.723235 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:27.723961 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:27.723965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:27.723967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:27.724098 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:27.724486 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:27.724489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:27.724491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:27.724768 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:27.724875 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:27.725563 (+ 688us) server_negotiation.cc:299] Negotiation successful
0619 04:41:27.725788 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":252,"threads_started":1}
I20260619 04:41:27.727385 21892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.709209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:34509 (local address 127.9.224.67:39369)
0619 04:41:27.709913 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:27.709951 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:27.711683 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:27.712446 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:27.712459 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:27.713026 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:41:27.713810 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.713835 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.715128 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.715134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.716340 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.716358 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.717164 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.717173 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.717428 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.718052 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:41:27.718079 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:41:27.720059 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:41:27.723365 (+ 3306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:41:27.723372 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:41:27.723385 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:41:27.723841 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:41:27.724201 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:41:27.724204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:41:27.724206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:41:27.724395 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:41:27.724870 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:41:27.724876 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:41:27.725222 (+ 346us) client_negotiation.cc:769] Sending connection context
0619 04:41:27.725450 (+ 228us) client_negotiation.cc:240] Negotiation successful
0619 04:41:27.725924 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":263,"threads_started":1}
I20260619 04:41:27.728819 21889 heartbeater.cc:347] Connected to a master server at 127.9.224.126:34509
I20260619 04:41:27.729103 21889 heartbeater.cc:464] Registering TS with master...
I20260619 04:41:27.729805 21889 heartbeater.cc:511] Master 127.9.224.126:34509 requested a full tablet report, sending...
I20260619 04:41:27.731339 21399 ts_manager.cc:194] Registered new tserver with Master: 0ae646f9d6bc4bfbb978af7b010133da (127.9.224.67:35527)
I20260619 04:41:27.732174 21399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:39369
I20260619 04:41:27.740721 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:41:27.760687 21891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.745715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45254 (local address 127.9.224.126:34509)
0619 04:41:27.745901 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:27.745905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:27.746480 (+ 575us) server_negotiation.cc:407] Connection header received
0619 04:41:27.746682 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:27.746686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:27.746770 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:27.746866 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:27.748431 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.749211 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.750884 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.751393 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.751513 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.754295 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:27.754303 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:27.754310 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:27.754358 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:27.757991 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:27.758896 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:27.758904 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:27.758910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:27.759092 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:27.759467 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:27.759474 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:27.759479 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:27.759779 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:27.759956 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:27.760277 (+ 321us) server_negotiation.cc:299] Negotiation successful
0619 04:41:27.760440 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:41:27.765111 21399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:41:27.772356 21399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:41:27.805459 21905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.787056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.9.224.66:37763)
0619 04:41:27.787789 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:27.787802 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:27.797203 (+ 9401us) server_negotiation.cc:407] Connection header received
0619 04:41:27.797305 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:27.797310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:27.797532 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:27.797731 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:41:27.798497 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.800151 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.802805 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.804257 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.804403 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.804624 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:27.804934 (+ 310us) server_negotiation.cc:299] Negotiation successful
0619 04:41:27.805117 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":334,"threads_started":1}
I20260619 04:41:27.805560 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.785505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:37763 (local address 127.0.0.1:35178)
0619 04:41:27.796743 (+ 11238us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:27.796790 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:27.796994 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:27.797733 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:27.797741 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:27.797769 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:41:27.798288 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.798304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.800350 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.800357 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.802655 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.802666 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.804482 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.804492 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.804706 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.804743 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 04:41:27.804886 (+ 143us) client_negotiation.cc:240] Negotiation successful
0619 04:41:27.805082 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11097,"spinlock_wait_cycles":3200,"thread_start_us":10053,"threads_started":1}
I20260619 04:41:27.808943 21906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.790154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40809 (local address 127.0.0.1:41574)
0619 04:41:27.798920 (+ 8766us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:27.798939 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:27.799054 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:27.801329 (+ 2275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:27.801334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:27.801367 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:41:27.801814 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.801826 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.803789 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.803796 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.806075 (+ 2279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.806084 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.808092 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.808098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.808275 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.808307 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 04:41:27.808388 (+ 81us) client_negotiation.cc:240] Negotiation successful
0619 04:41:27.808523 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8638,"mutex_wait_us":42,"thread_start_us":8507,"threads_started":1}
I20260619 04:41:27.809782 21907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.790893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41574 (local address 127.9.224.65:40809)
0619 04:41:27.798499 (+ 7606us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:27.798508 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:27.799187 (+ 679us) server_negotiation.cc:407] Connection header received
0619 04:41:27.799285 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:27.799293 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:27.799537 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:27.799718 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:41:27.801994 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.803613 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.806296 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.807600 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.807731 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.807957 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:27.809290 (+ 1333us) server_negotiation.cc:299] Negotiation successful
0619 04:41:27.809463 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7409,"thread_start_us":7223,"threads_started":1}
I20260619 04:41:27.810271 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.785270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:35527 (local address 127.0.0.1:56636)
0619 04:41:27.796743 (+ 11473us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:27.796795 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:27.796994 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:27.801030 (+ 4036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:27.801034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:27.801060 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:41:27.801539 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.801549 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.803534 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.803542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.806034 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:27.806051 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.809428 (+ 3377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.809434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:27.809619 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.809650 (+ 31us) client_negotiation.cc:769] Sending connection context
0619 04:41:27.809738 (+ 88us) client_negotiation.cc:240] Negotiation successful
0619 04:41:27.809877 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10477,"mutex_wait_us":67,"spinlock_wait_cycles":4992,"thread_start_us":11177,"threads_started":1}
I20260619 04:41:27.811033 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:27.785965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56636 (local address 127.9.224.67:35527)
0619 04:41:27.800394 (+ 14429us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:27.800407 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:27.800439 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:41:27.800574 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:27.800581 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:27.800836 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:27.801027 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:41:27.801749 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.803372 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.806226 (+ 2854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:27.807687 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:27.807841 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:27.808056 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:27.810552 (+ 2496us) server_negotiation.cc:299] Negotiation successful
0619 04:41:27.810724 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14251,"thread_start_us":14067,"threads_started":1}
I20260619 04:41:27.810509 21690 tablet_service.cc:1467] Processing CreateTablet for tablet 7354552de570469ea5f2de5563f259c5 (DEFAULT_TABLE table=test-table [id=d1feb5adf9114e2182442ecc62640a15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:41:27.811908 21690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7354552de570469ea5f2de5563f259c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:41:27.813841 21547 tablet_service.cc:1467] Processing CreateTablet for tablet 7354552de570469ea5f2de5563f259c5 (DEFAULT_TABLE table=test-table [id=d1feb5adf9114e2182442ecc62640a15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:41:27.815717 21547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7354552de570469ea5f2de5563f259c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:41:27.818064 21824 tablet_service.cc:1467] Processing CreateTablet for tablet 7354552de570469ea5f2de5563f259c5 (DEFAULT_TABLE table=test-table [id=d1feb5adf9114e2182442ecc62640a15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:41:27.819528 21824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7354552de570469ea5f2de5563f259c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:41:27.832352 21908 tablet_bootstrap.cc:492] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Bootstrap starting.
I20260619 04:41:27.834959 21910 tablet_bootstrap.cc:492] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Bootstrap starting.
I20260619 04:41:27.836117 21908 tablet_bootstrap.cc:654] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Neither blocks nor log segments found. Creating new log.
I20260619 04:41:27.837172 21908 log.cc:824] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:41:27.837920 21909 tablet_bootstrap.cc:492] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Bootstrap starting.
I20260619 04:41:27.838966 21910 tablet_bootstrap.cc:654] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Neither blocks nor log segments found. Creating new log.
I20260619 04:41:27.840085 21908 tablet_bootstrap.cc:492] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: No bootstrap required, opened a new log
I20260619 04:41:27.840253 21910 log.cc:824] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Log is configured to *not* fsync() on all Append() calls
I20260619 04:41:27.840390 21908 ts_tablet_manager.cc:1397] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260619 04:41:27.841985 21909 tablet_bootstrap.cc:654] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Neither blocks nor log segments found. Creating new log.
I20260619 04:41:27.843307 21909 log.cc:824] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Log is configured to *not* fsync() on all Append() calls
I20260619 04:41:27.843988 21910 tablet_bootstrap.cc:492] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: No bootstrap required, opened a new log
I20260619 04:41:27.844291 21910 ts_tablet_manager.cc:1397] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260619 04:41:27.846088 21909 tablet_bootstrap.cc:492] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: No bootstrap required, opened a new log
I20260619 04:41:27.846412 21909 ts_tablet_manager.cc:1397] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260619 04:41:27.851854 21908 raft_consensus.cc:348] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:27.852484 21908 raft_consensus.cc:374] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:41:27.852602 21908 raft_consensus.cc:729] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c8ef98bc454abe93b1b78b88bfdb7c, State: Initialized, Role: FOLLOWER
I20260619 04:41:27.853319 21908 consensus_queue.cc:260] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:27.853932 21909 raft_consensus.cc:348] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:27.854458 21909 raft_consensus.cc:374] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:41:27.854584 21909 raft_consensus.cc:729] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e18716e437b40519da305483558e79f, State: Initialized, Role: FOLLOWER
I20260619 04:41:27.854645 21755 heartbeater.cc:503] Master 127.9.224.126:34509 was elected leader, sending a full tablet report...
I20260619 04:41:27.855144 21910 raft_consensus.cc:348] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:27.855435 21908 ts_tablet_manager.cc:1428] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260619 04:41:27.855562 21910 raft_consensus.cc:374] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:41:27.855670 21910 raft_consensus.cc:729] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ae646f9d6bc4bfbb978af7b010133da, State: Initialized, Role: FOLLOWER
I20260619 04:41:27.856309 21910 consensus_queue.cc:260] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:27.856948 21909 consensus_queue.cc:260] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:27.857594 21889 heartbeater.cc:503] Master 127.9.224.126:34509 was elected leader, sending a full tablet report...
I20260619 04:41:27.858300 21910 ts_tablet_manager.cc:1428] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260619 04:41:27.860144 21909 ts_tablet_manager.cc:1428] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Time spent starting tablet: real 0.014s user 0.009s sys 0.002s
W20260619 04:41:27.915036 21756 tablet.cc:2369] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:41:27.947877 21613 tablet.cc:2369] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:41:27.957784 21890 tablet.cc:2369] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:41:28.041544 21914 raft_consensus.cc:482] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:41:28.041842 21914 raft_consensus.cc:504] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:28.043816 21914 leader_election.cc:288] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ae646f9d6bc4bfbb978af7b010133da (127.9.224.67:35527), 6e18716e437b40519da305483558e79f (127.9.224.65:40809)
I20260619 04:41:28.050938 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.044287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:56275 (local address 127.9.224.67:35527)
0619 04:41:28.044480 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:28.044487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:28.045251 (+ 764us) server_negotiation.cc:407] Connection header received
0619 04:41:28.045442 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:28.045448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:28.045526 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:28.045635 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:41:28.046477 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.047194 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.049072 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.049885 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.050079 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.050157 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:28.050538 (+ 381us) server_negotiation.cc:299] Negotiation successful
0619 04:41:28.050672 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 04:41:28.050989 21907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.044347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:50179 (local address 127.9.224.65:40809)
0619 04:41:28.044530 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:28.044538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:28.045233 (+ 695us) server_negotiation.cc:407] Connection header received
0619 04:41:28.045455 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:28.045460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:28.045545 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:28.045635 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:41:28.046431 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.047387 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.049183 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.049964 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.050142 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.050222 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:28.050592 (+ 370us) server_negotiation.cc:299] Negotiation successful
0619 04:41:28.050733 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 04:41:28.051187 21918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.044054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:35527 (local address 127.9.224.66:56275)
0619 04:41:28.045063 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:28.045084 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:28.045277 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:28.045688 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:28.045693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:28.045778 (+ 85us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:41:28.046274 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:28.046287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.047342 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.047347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:28.048896 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:28.048909 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.050119 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.050129 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:28.050363 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.050397 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 04:41:28.050500 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 04:41:28.050649 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":872,"mutex_wait_us":21,"spinlock_wait_cycles":24320,"thread_start_us":694,"threads_started":1}
I20260619 04:41:28.051246 21917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.044183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40809 (local address 127.9.224.66:50179)
0619 04:41:28.045141 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0619 04:41:28.045156 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:41:28.045310 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:41:28.045688 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:41:28.045693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:41:28.045720 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:41:28.046274 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:28.046287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.047528 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.047536 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:28.049012 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:41:28.049024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.050187 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.050193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:41:28.050430 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.050453 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 04:41:28.050552 (+ 99us) client_negotiation.cc:240] Negotiation successful
0619 04:41:28.050681 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"mutex_wait_us":29,"thread_start_us":448,"threads_started":1}
I20260619 04:41:28.052377 21567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7354552de570469ea5f2de5563f259c5" candidate_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e18716e437b40519da305483558e79f" is_pre_election: true
I20260619 04:41:28.052502 21844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7354552de570469ea5f2de5563f259c5" candidate_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ae646f9d6bc4bfbb978af7b010133da" is_pre_election: true
I20260619 04:41:28.052902 21567 raft_consensus.cc:2454] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c8ef98bc454abe93b1b78b88bfdb7c in term 0.
I20260619 04:41:28.053030 21844 raft_consensus.cc:2454] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71c8ef98bc454abe93b1b78b88bfdb7c in term 0.
I20260619 04:41:28.053619 21643 leader_election.cc:302] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0ae646f9d6bc4bfbb978af7b010133da, 6e18716e437b40519da305483558e79f, 71c8ef98bc454abe93b1b78b88bfdb7c; no voters:
I20260619 04:41:28.054039 21914 raft_consensus.cc:2781] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:41:28.054201 21914 raft_consensus.cc:482] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:41:28.054350 21914 raft_consensus.cc:3037] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:41:28.056951 21914 raft_consensus.cc:504] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:28.057654 21914 leader_election.cc:288] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [CANDIDATE]: Term 1 election: Requested vote from peers 0ae646f9d6bc4bfbb978af7b010133da (127.9.224.67:35527), 6e18716e437b40519da305483558e79f (127.9.224.65:40809)
I20260619 04:41:28.058142 21844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7354552de570469ea5f2de5563f259c5" candidate_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ae646f9d6bc4bfbb978af7b010133da"
I20260619 04:41:28.058244 21567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7354552de570469ea5f2de5563f259c5" candidate_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e18716e437b40519da305483558e79f"
I20260619 04:41:28.058372 21844 raft_consensus.cc:3037] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:41:28.058527 21567 raft_consensus.cc:3037] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:41:28.060622 21844 raft_consensus.cc:2454] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c8ef98bc454abe93b1b78b88bfdb7c in term 1.
I20260619 04:41:28.060830 21567 raft_consensus.cc:2454] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71c8ef98bc454abe93b1b78b88bfdb7c in term 1.
I20260619 04:41:28.061085 21646 leader_election.cc:302] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ae646f9d6bc4bfbb978af7b010133da, 71c8ef98bc454abe93b1b78b88bfdb7c; no voters:
I20260619 04:41:28.061404 21914 raft_consensus.cc:2781] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:41:28.061864 21914 raft_consensus.cc:686] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 1 LEADER]: Becoming Leader. State: Replica: 71c8ef98bc454abe93b1b78b88bfdb7c, State: Running, Role: LEADER
I20260619 04:41:28.062520 21914 consensus_queue.cc:237] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } }
I20260619 04:41:28.067451 21398 catalog_manager.cc:5495] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 71c8ef98bc454abe93b1b78b88bfdb7c (127.9.224.66). New cstate: current_term: 1 leader_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c8ef98bc454abe93b1b78b88bfdb7c" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 37763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 } health_report { overall_health: UNKNOWN } } }
I20260619 04:41:28.099402 21905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.094207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35192 (local address 127.9.224.66:37763)
0619 04:41:28.094446 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:28.094450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:28.094467 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:41:28.094646 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:28.094650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:28.094756 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:28.094880 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:41:28.095211 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.095910 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.097402 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.097802 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.097895 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.098410 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:41:28.098922 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:41:28.099038 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:28.099127 (+ 89us) server_negotiation.cc:299] Negotiation successful
0619 04:41:28.099188 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260619 04:41:28.107703 21567 raft_consensus.cc:1261] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 1 FOLLOWER]: Refusing update from remote peer 71c8ef98bc454abe93b1b78b88bfdb7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:41:28.107702 21844 raft_consensus.cc:1261] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 1 FOLLOWER]: Refusing update from remote peer 71c8ef98bc454abe93b1b78b88bfdb7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:41:28.108778 21919 consensus_queue.cc:1035] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e18716e437b40519da305483558e79f" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:41:28.109179 21914 consensus_queue.cc:1035] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ae646f9d6bc4bfbb978af7b010133da" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:41:28.123011 21922 mvcc.cc:205] Tried to move back new op lower bound from 7298433384879452160 to 7298433384708927488. Current Snapshot: MvccSnapshot[applied={T|T < 7298433384879452160}]
I20260619 04:41:28.135960 21399 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:41:28.136229 21399 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:41:28.139830 21399 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bcd56d760c6147ac968304c6ec138ba2: Sending DeleteTablet for 3 replicas of tablet 7354552de570469ea5f2de5563f259c5
I20260619 04:41:28.140894 21824 tablet_service.cc:1514] Processing DeleteTablet for tablet 7354552de570469ea5f2de5563f259c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:41:28 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:56636
I20260619 04:41:28.141144 21547 tablet_service.cc:1514] Processing DeleteTablet for tablet 7354552de570469ea5f2de5563f259c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:41:28 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:41574
I20260619 04:41:28.141744 21932 tablet_replica.cc:330] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: stopping tablet replica
I20260619 04:41:28.141664 21690 tablet_service.cc:1514] Processing DeleteTablet for tablet 7354552de570469ea5f2de5563f259c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:41:28 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:35178
I20260619 04:41:28.142189 21932 raft_consensus.cc:2229] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:41:28.144325 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 21479
I20260619 04:41:28.152366 21932 raft_consensus.cc:2258] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:41:28.153301 21934 tablet_replica.cc:330] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: stopping tablet replica
I20260619 04:41:28.153765 21934 raft_consensus.cc:2229] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:41:28.154131 21933 tablet_replica.cc:330] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: stopping tablet replica
I20260619 04:41:28.154662 21934 raft_consensus.cc:2258] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:41:28.154659 21933 raft_consensus.cc:2229] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:41:28.155303 21933 raft_consensus.cc:2258] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:41:28.155722 21932 ts_tablet_manager.cc:1905] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:41:28.156785 21934 ts_tablet_manager.cc:1905] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:41:28.164695 21934 ts_tablet_manager.cc:1918] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:41:28.164899 21934 log.cc:1196] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/7354552de570469ea5f2de5563f259c5
I20260619 04:41:28.165251 21932 ts_tablet_manager.cc:1918] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:41:28.165446 21934 ts_tablet_manager.cc:1939] T 7354552de570469ea5f2de5563f259c5 P 71c8ef98bc454abe93b1b78b88bfdb7c: Deleting consensus metadata
I20260619 04:41:28.165469 21932 log.cc:1196] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/7354552de570469ea5f2de5563f259c5
I20260619 04:41:28.165972 21932 ts_tablet_manager.cc:1939] T 7354552de570469ea5f2de5563f259c5 P 0ae646f9d6bc4bfbb978af7b010133da: Deleting consensus metadata
I20260619 04:41:28.167428 21384 catalog_manager.cc:4841] TS 71c8ef98bc454abe93b1b78b88bfdb7c (127.9.224.66:37763): tablet 7354552de570469ea5f2de5563f259c5 (table test-table [id=d1feb5adf9114e2182442ecc62640a15]) successfully deleted
I20260619 04:41:28.168391 21386 catalog_manager.cc:4841] TS 0ae646f9d6bc4bfbb978af7b010133da (127.9.224.67:35527): tablet 7354552de570469ea5f2de5563f259c5 (table test-table [id=d1feb5adf9114e2182442ecc62640a15]) successfully deleted
I20260619 04:41:28.169822 21933 ts_tablet_manager.cc:1905] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 04:41:28 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:41:28.176570 21933 ts_tablet_manager.cc:1918] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:41:28.176754 21933 log.cc:1196] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/7354552de570469ea5f2de5563f259c5
I20260619 04:41:28.177296 21933 ts_tablet_manager.cc:1939] T 7354552de570469ea5f2de5563f259c5 P 6e18716e437b40519da305483558e79f: Deleting consensus metadata
I20260619 04:41:28.179283 21383 catalog_manager.cc:4841] TS 6e18716e437b40519da305483558e79f (127.9.224.65:40809): tablet 7354552de570469ea5f2de5563f259c5 (table test-table [id=d1feb5adf9114e2182442ecc62640a15]) successfully deleted
I20260619 04:41:28.179368 21907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.145498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41590 (local address 127.9.224.65:40809)
0619 04:41:28.145688 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:28.145697 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:28.159273 (+ 13576us) server_negotiation.cc:407] Connection header received
0619 04:41:28.159479 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:28.159485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:28.159572 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:28.159692 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:28.161663 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.162806 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.164803 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.165448 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.165544 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.171427 (+ 5883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:28.171443 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:28.171469 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:28.171522 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:28.175590 (+ 4068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:28.176567 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:28.176577 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:28.176581 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:28.176927 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:28.177451 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:28.177456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:28.177460 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:28.177905 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:28.178169 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:28.178762 (+ 593us) server_negotiation.cc:299] Negotiation successful
0619 04:41:28.179015 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:41:28.180948 21607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:41:28.317842 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 21479
I20260619 04:41:28.341598 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 21618
Jun 19 04:41:28 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:41:28.360543 21905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.342448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35202 (local address 127.9.224.66:37763)
0619 04:41:28.342632 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:28.342636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:28.342722 (+ 86us) server_negotiation.cc:407] Connection header received
0619 04:41:28.342905 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:28.342909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:28.342998 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:28.343085 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:28.344757 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.345707 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.347601 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.348027 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.348121 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.353524 (+ 5403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:28.353543 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:28.353559 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:28.353603 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:28.357216 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:28.358062 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:28.358069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:28.358072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:28.358198 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:28.358702 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:28.358709 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:28.358720 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:28.359291 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:28.359634 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:28.359936 (+ 302us) server_negotiation.cc:299] Negotiation successful
0619 04:41:28.360159 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:41:28.361244 21750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:41:28.476912 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 21618
I20260619 04:41:28.494604 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 21761
Jun 19 04:41:28 dist-test-slave-9dgf krb5kdc[20923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:41:28.510090 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:41:28.495508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56638 (local address 127.9.224.67:35527)
0619 04:41:28.495678 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0619 04:41:28.495683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:41:28.495700 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:41:28.495829 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:41:28.495850 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:41:28.495912 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:41:28.495992 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:41:28.497247 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.497956 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.499257 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:41:28.499637 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:41:28.499731 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:41:28.504194 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:41:28.504206 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:41:28.504221 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:41:28.504252 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:41:28.507284 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:28.508017 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:28.508025 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:28.508027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:28.508163 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:41:28.508543 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:41:28.508547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:41:28.508549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:41:28.508957 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:41:28.509186 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0619 04:41:28.509502 (+ 316us) server_negotiation.cc:299] Negotiation successful
0619 04:41:28.509680 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 04:41:28.510941 21884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:41:28.600589 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 21761
I20260619 04:41:28.616957 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 21367
I20260619 04:41:28.618129 21429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:41:28.734962 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 21367
I20260619 04:41:28.760950 10113 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260619 04:41:29.096572 10113 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260619 04:41:29.096951 10113 mini_ranger.cc:66] Stopping Ranger...
I20260619 04:41:29.442883 10113 mini_ranger.cc:68] Stopped Ranger
2026-06-19 04:41:29.443 UTC [20953] LOG: received smart shutdown request
2026-06-19 04:41:29.446 UTC [20953] LOG: background worker "logical replication launcher" (PID 20962) exited with exit code 1
2026-06-19 04:41:29.447 UTC [20957] LOG: shutting down
2026-06-19 04:41:29.635 UTC [20953] LOG: database system is shut down
2026-06-19T04:41:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49769 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:41:29 dist-test-slave-9dgf krb5kdc[21948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:41:29 dist-test-slave-9dgf krb5kdc[21948](info): set up 2 sockets
Jun 19 04:41:29 dist-test-slave-9dgf krb5kdc[21948](info): commencing operation
krb5kdc: starting...
W20260619 04:41:30.878742 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.015s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:41:31 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:41:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:41:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/rangeradmin_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/rangeradmin_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/rangerlookup_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/rangerlookup_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
I20260619 04:41:31.221321 10113 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXgzdm0/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/postgres -l logfile start
2026-06-19 04:41:33.925 UTC [21978] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-19 04:41:33.925 UTC [21978] LOG: listening on IPv4 address "127.9.224.84", port 46255
2026-06-19 04:41:33.929 UTC [21978] LOG: listening on Unix socket "/tmp/.s.PGSQL.46255"
2026-06-19 04:41:33.951 UTC [21981] LOG: database system was shut down at 2026-06-19 04:41:32 UTC
2026-06-19 04:41:33.954 UTC [21978] LOG: database system is ready to accept connections
I20260619 04:41:34.934459 10113 mini_postgres.cc:96] Postgres bound to 46255
2026-06-19 04:41:34.951 UTC [21989] FATAL: database "slave" does not exist
127.9.224.84:46255 - accepting connections
I20260619 04:41:34.952404 10113 mini_ranger.cc:161] Starting Ranger...
I20260619 04:41:34.978941 10113 mini_ranger.cc:84] Created miniranger Postgres user
I20260619 04:41:35.498389 10113 mini_ranger.cc:87] Created ranger Postgres database
I20260619 04:41:35.498533 10113 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-admin
2026-06-19 04:41:35,800 [I] DB FLAVOR :POSTGRES
2026-06-19 04:41:35,801 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 04:41:35,801 [I] Checking connection..
2026-06-19 04:41:35,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-19 04:41:36,036 [I] Checking connection passed.
2026-06-19 04:41:36,036 [I] --------- Verifying version history table ---------
2026-06-19 04:41:36,036 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 04:41:36,282 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 04:41:36,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 04:41:36,528 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 04:41:36,528 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-19 04:41:36,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-19 04:41:36.789 UTC [22053] WARNING: there is no transaction in progress
2026-06-19 04:41:36,796 [I] create_dbversion_catalog.sql file imported successfully
2026-06-19 04:41:36,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 04:41:37,059 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-19 04:41:37,060 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 04:41:37,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-19 04:41:37,314 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-19 04:41:37,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-9dgf.c.gcp-upstream.internal','N') ;"
2026-06-19 04:41:37,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 04:41:38,060 [I] Table x_portal_user does not exist in database ranger
2026-06-19 04:41:38,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 04:41:38,319 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-19 04:41:38,320 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 04:41:38,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 04:41:38,798 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-19 04:41:38,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-19 04:41:39.817 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.836 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.854 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.870 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.888 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.908 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.973 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.980 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:39.995 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.006 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.019 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.034 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.044 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.052 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.059 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40.067 UTC [22161] WARNING: there is no transaction in progress
2026-06-19 04:41:40,749 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-19 04:41:40,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-19 04:41:41,000 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-19 04:41:41,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 04:41:41,253 [I] Table x_portal_user already exists in database 'ranger'
2026-06-19 04:41:41,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 04:41:41,501 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-19 04:41:41,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 04:41:41,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 04:41:41,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-9dgf.c.gcp-upstream.internal';"
2026-06-19 04:41:42,226 [I] CORE_DB_SCHEMA import status has been updated
2026-06-19 04:41:42,226 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-19 04:41:42,499 [I] DB_PATCHES have already been applied
I20260619 04:41:42.505574 10113 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXgzdm0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260619 04:41:42.505669 10113 mini_ranger.cc:193] Using host: 127.9.224.84
I20260619 04:41:42.521613 10113 mini_ranger.cc:227] Ranger admin URL: http://127.9.224.84:33655
Jun 19, 2026 4:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 4:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 4:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp
Jun 19, 2026 4:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 19, 2026 4:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 19, 2026 4:41:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-admin/ews/webapp].
Jun 19, 2026 4:41:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260619 04:41:43.652673 10113 mini_ranger.cc:160] Time spent starting Ranger: real 8.700s user 0.000s sys 0.041s
Jun 19, 2026 4:42:04 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 19, 2026 4:42:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 19, 2026 4:42:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 19, 2026 4:42:04 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 19, 2026 4:42:05 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260619 04:42:05.860857 10113 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.224.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.224.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/rangerkms_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.224.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/rangerkms_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.224.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.224.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.224.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/HTTP_127.9.224.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 19 04:42:06 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844126, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260619 04:42:06.027602 10113 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260619 04:42:06.049134 10113 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260619 04:42:06.985081 10113 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260619 04:42:06.985204 10113 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms
I20260619 04:42:06.985338 10113 mini_ranger_kms.cc:227] Using postgres at 127.9.224.84:46255
2026-06-19 04:42:07,329 [I] DB FLAVOR :POSTGRES
2026-06-19 04:42:07,329 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 04:42:07,329 [I] Checking connection
2026-06-19 04:42:07,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-19 04:42:07,565 [I] connection success
2026-06-19 04:42:07,565 [I] --------- Verifying Ranger DB tables ---------
2026-06-19 04:42:07,565 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-19 04:42:07,565 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-19 04:42:07,812 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-19 04:42:07,812 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 04:42:07,812 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-19 04:42:07,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.224.84:46255/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-19 04:42:08,096 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260619 04:42:08.546012 10113 mini_ranger_kms.cc:310] Created kms service
I20260619 04:42:08.785063 10113 mini_ranger_kms.cc:326] Created kudu user
I20260619 04:42:08.831399 10113 mini_ranger_kms.cc:343] Created rangerkms user
Jun 19 04:42:08 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844126, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:09.230298 10113 mini_ranger_kms.cc:384] Added ranger policy
I20260619 04:42:09.230649 10113 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXgzdm0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXgzdm0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260619 04:42:09.230698 10113 mini_ranger_kms.cc:240] Using host: 127.9.224.84
I20260619 04:42:09.249747 10113 mini_ranger_kms.cc:276] Ranger KMS PID: 22341
I20260619 04:42:09.249912 10113 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.224.84:52021
Jun 19, 2026 4:42:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 4:42:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 4:42:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 19, 2026 4:42:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 19, 2026 4:42:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-kms/ews/webapp].
Jun 19, 2026 4:42:10 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260619 04:42:11.512432 10113 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.485s user 0.060s sys 0.298s
I20260619 04:42:11.512678 10113 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260619 04:42:11.512861 10113 mini_ranger_kms.cc:401] 127.9.224.84:52021/kms/v1/keys
Jun 19 04:42:11 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781844131, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.224.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 19 04:42:12 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844131, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.224.84@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
Jun 19 04:42:12 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844131, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.224.84@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
Jun 19 04:42:14 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:42:14.886173 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40731
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:40731
--ranger_config_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:15.220964 22392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:15.221333 22392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:15.221494 22392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:15.228931 22392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:15.229111 22392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:15.229218 22392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:15.229315 22392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:15.229408 22392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:15.239979 22392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.224.84:52021/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:40731
--ranger_config_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:15.241371 22392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:15.242825 22392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:15.257248 22398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:15.257274 22400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:15.257629 22397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:15.258128 22392 server_base.cc:1034] running on GCE node
I20260619 04:42:15.259006 22392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:15.260555 22392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:15.261809 22392 hybrid_clock.cc:648] HybridClock initialized: now 1781844135261774 us; error 53 us; skew 500 ppm
I20260619 04:42:15.262219 22392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:15 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844135, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:15.265501 22392 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:15.267252 22392 webserver.cc:460] Webserver started at http://127.9.224.126:33047/ using document root <none> and password file <none>
I20260619 04:42:15.267975 22392 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:15.268103 22392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:15.268460 22392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:42:15 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844135, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:15.326349 22392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "031c3a3f7dc64333972a89740ebb58f9"
format_stamp: "Formatted at 2026-06-19 04:42:15 on dist-test-slave-9dgf"
server_key: "2d2abededc0ab709c8d472dd542a8a02"
server_key_iv: "4ff56e056f0227a69ad4abfdf5422110"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:15.327680 22392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "031c3a3f7dc64333972a89740ebb58f9"
format_stamp: "Formatted at 2026-06-19 04:42:15 on dist-test-slave-9dgf"
server_key: "2d2abededc0ab709c8d472dd542a8a02"
server_key_iv: "4ff56e056f0227a69ad4abfdf5422110"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:15.333642 22392 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260619 04:42:15.354616 22407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:15.356825 22392 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260619 04:42:15.357055 22392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "031c3a3f7dc64333972a89740ebb58f9"
format_stamp: "Formatted at 2026-06-19 04:42:15 on dist-test-slave-9dgf"
server_key: "2d2abededc0ab709c8d472dd542a8a02"
server_key_iv: "4ff56e056f0227a69ad4abfdf5422110"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:15.357345 22392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:15.379541 22392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:15.383935 22392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:15.384282 22392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:15.404618 22392 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:40731
I20260619 04:42:15.404672 22458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:40731 every 8 connection(s)
I20260619 04:42:15.406056 22392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:15.410084 22459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:15.415195 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 22392
I20260619 04:42:15.415433 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:42:15.416119 10113 external_mini_cluster.cc:1428] Setting key 070094f4f6209d23e2fe58f77e00a028
I20260619 04:42:15.422366 22459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Bootstrap starting.
I20260619 04:42:15.426302 22459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:15.427400 22459 log.cc:824] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:15.430698 22459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: No bootstrap required, opened a new log
Jun 19 04:42:15 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:15.439757 22459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:15.440158 22459 raft_consensus.cc:374] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:15.440296 22459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 031c3a3f7dc64333972a89740ebb58f9, State: Initialized, Role: FOLLOWER
I20260619 04:42:15.441066 22462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:15.418343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.9.224.126:40731)
0619 04:42:15.419190 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:15.419207 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:15.419259 (+ 52us) server_negotiation.cc:407] Connection header received
0619 04:42:15.421603 (+ 2344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:15.421630 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:15.422161 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:15.422627 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:15.423899 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:15.425916 (+ 2017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:15.427448 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:15.428460 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:15.428610 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:15.432946 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:15.432957 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:15.432977 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:15.433032 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:15.436535 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:15.437276 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:15.437284 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:15.437297 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:15.437454 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:15.437870 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:15.437874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:15.437879 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:15.438527 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:15.438895 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:15.439365 (+ 470us) server_negotiation.cc:299] Negotiation successful
0619 04:42:15.439775 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":362,"threads_started":1}
I20260619 04:42:15.440981 22459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:15.441318 22459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:15.441504 22459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:15.441700 22459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:15.444183 22459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:15.444747 22459 leader_election.cc:302] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 031c3a3f7dc64333972a89740ebb58f9; no voters:
I20260619 04:42:15.445350 22459 leader_election.cc:288] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:42:15.445508 22464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:15.446270 22464 raft_consensus.cc:686] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 LEADER]: Becoming Leader. State: Replica: 031c3a3f7dc64333972a89740ebb58f9, State: Running, Role: LEADER
I20260619 04:42:15.446898 22464 consensus_queue.cc:237] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:15.447633 22459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:15.449895 22465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "031c3a3f7dc64333972a89740ebb58f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } } }
I20260619 04:42:15.450309 22465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:15.450002 22466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 031c3a3f7dc64333972a89740ebb58f9. Latest consensus state: current_term: 1 leader_uuid: "031c3a3f7dc64333972a89740ebb58f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } } }
I20260619 04:42:15.450453 22466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:15.451319 22469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:15.464511 22469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:15.465338 22459 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 04:42:15.498802 22469 catalog_manager.cc:1347] Generated new cluster ID: 02abcedefd994c76b76a2417742d9167
I20260619 04:42:15.498955 22469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:15.519711 22469 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:42:15.521733 22469 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:15.529356 22469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Generated new TSK 0
I20260619 04:42:15.530615 22469 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:42:16.283057 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:40731
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:42:16 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781844136, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260619 04:42:16.733095 22504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:16.733433 22504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:16.733605 22504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:16.744923 22504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:16.745092 22504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:16.745289 22504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:42:16.757803 22504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.224.84:52021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:40731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:16.759780 22504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:16.761461 22504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:16.776697 22514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:16.776695 22517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:16.776765 22515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:16.778692 22504 server_base.cc:1034] running on GCE node
I20260619 04:42:16.779354 22504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:16.780500 22504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:16.781767 22504 hybrid_clock.cc:648] HybridClock initialized: now 1781844136781706 us; error 66 us; skew 500 ppm
I20260619 04:42:16.782272 22504 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:16 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844136, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:16.790959 22504 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:42:16.792752 22504 webserver.cc:460] Webserver started at http://127.9.224.65:38871/ using document root <none> and password file <none>
I20260619 04:42:16.793569 22504 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:16.793716 22504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:16.794049 22504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:42:16 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844136, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:16.819893 22504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "503eb09b32f64c2881f5a349cf7bf990"
format_stamp: "Formatted at 2026-06-19 04:42:16 on dist-test-slave-9dgf"
server_key: "1d89b3958bda176ffb9f98f4c9e09a7a"
server_key_iv: "40b3e12561038402bcd58884154d882e"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:16.821445 22504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "503eb09b32f64c2881f5a349cf7bf990"
format_stamp: "Formatted at 2026-06-19 04:42:16 on dist-test-slave-9dgf"
server_key: "1d89b3958bda176ffb9f98f4c9e09a7a"
server_key_iv: "40b3e12561038402bcd58884154d882e"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:16.835387 22504 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.008s sys 0.004s
I20260619 04:42:16.871393 22524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:16.873526 22504 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.003s sys 0.007s
I20260619 04:42:16.873778 22504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "503eb09b32f64c2881f5a349cf7bf990"
format_stamp: "Formatted at 2026-06-19 04:42:16 on dist-test-slave-9dgf"
server_key: "1d89b3958bda176ffb9f98f4c9e09a7a"
server_key_iv: "40b3e12561038402bcd58884154d882e"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:16.874068 22504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:16.918150 22504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:16.924023 22504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:16.924455 22504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:16.941051 22504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:16.949721 22504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:16.949929 22504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 04:42:16.950135 22504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:16.950269 22504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 04:42:17 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844136, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:17.319568 22504 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:34587
I20260619 04:42:17.319626 22636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:34587 every 8 connection(s)
I20260619 04:42:17.321398 22504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:42:17.329905 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 22504
I20260619 04:42:17.330127 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:42:17.330961 10113 external_mini_cluster.cc:1428] Setting key 37a399bfa1f03d45d1b5b2dee3cab050
Jun 19 04:42:17 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844136, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:17.362847 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:17.324647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:50413 (local address 127.9.224.126:40731)
0619 04:42:17.342172 (+ 17525us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:17.342178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:17.342195 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:42:17.342265 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:17.342282 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:17.342374 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:17.342517 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:17.344583 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:17.345753 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:17.348297 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:17.349028 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:17.349146 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:17.353792 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:17.353799 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:17.353805 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:17.353857 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:17.357697 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:17.358713 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:17.358719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:17.358723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:17.358885 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:17.359387 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:17.359392 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:17.359396 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:17.360010 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:17.360153 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:17.362119 (+ 1966us) server_negotiation.cc:299] Negotiation successful
0619 04:42:17.362366 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17384,"thread_start_us":17242,"threads_started":1}
I20260619 04:42:17.364252 22640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:17.325418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40731 (local address 127.9.224.65:50413)
0619 04:42:17.336535 (+ 11117us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:17.336623 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:17.341238 (+ 4615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:17.342846 (+ 1608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:17.342860 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:17.343510 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:17.344356 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:17.344381 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:17.345954 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:17.345960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:17.348071 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:17.348088 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:17.349500 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:17.349506 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:17.349817 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:17.350693 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:17.350728 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:17.353435 (+ 2707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:17.357922 (+ 4487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:17.357932 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:17.357953 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:17.358560 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:17.359012 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:17.359017 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:17.359021 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:17.359256 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:17.360221 (+ 965us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:17.360230 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:17.360679 (+ 449us) client_negotiation.cc:769] Sending connection context
0619 04:42:17.360993 (+ 314us) client_negotiation.cc:240] Negotiation successful
0619 04:42:17.361527 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10617,"thread_start_us":12699,"threads_started":1}
I20260619 04:42:17.366375 22637 heartbeater.cc:347] Connected to a master server at 127.9.224.126:40731
I20260619 04:42:17.366729 22637 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:17.367722 22637 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:17.370482 22424 ts_manager.cc:194] Registered new tserver with Master: 503eb09b32f64c2881f5a349cf7bf990 (127.9.224.65:34587)
I20260619 04:42:17.372524 22424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:50413
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:42:17.418955 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:40731
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:42:17 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844136, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
W20260619 04:42:17.934700 22643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:17.935228 22643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:17.935438 22643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:17.944463 22643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:17.944641 22643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:17.944837 22643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:42:17.955945 22643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.224.84:52021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:40731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:17.957515 22643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:17.959020 22643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:17.980262 22658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:17.980182 22657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:17.985065 22660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:17.985916 22643 server_base.cc:1034] running on GCE node
I20260619 04:42:17.986716 22643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:17.988039 22643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:17.989334 22643 hybrid_clock.cc:648] HybridClock initialized: now 1781844137989276 us; error 56 us; skew 500 ppm
I20260619 04:42:17.989702 22643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:17 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844137, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:17.993089 22643 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:42:17.995290 22643 webserver.cc:460] Webserver started at http://127.9.224.66:45823/ using document root <none> and password file <none>
I20260619 04:42:17.996071 22643 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:17.996238 22643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:17.996563 22643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:42:17 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844137, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:18.023947 22643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "e8dbac1d1377479ebae9836ed502cf75"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "70fbc7e4f14b6828b9edaafcc94cee16"
server_key_iv: "ff615527c87963eef856fe2dc61b0d5f"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:18.025359 22643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "e8dbac1d1377479ebae9836ed502cf75"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "70fbc7e4f14b6828b9edaafcc94cee16"
server_key_iv: "ff615527c87963eef856fe2dc61b0d5f"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:18.048413 22643 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.009s sys 0.012s
I20260619 04:42:18.080374 22667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:18.082569 22643 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.007s sys 0.006s
I20260619 04:42:18.082834 22643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "e8dbac1d1377479ebae9836ed502cf75"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "70fbc7e4f14b6828b9edaafcc94cee16"
server_key_iv: "ff615527c87963eef856fe2dc61b0d5f"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:18.083164 22643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:18.128674 22643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:18.134204 22643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:18.134663 22643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:18.142066 22643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:18.150538 22643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:18.150736 22643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:18.150918 22643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:18.151021 22643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:18.376540 22637 heartbeater.cc:503] Master 127.9.224.126:40731 was elected leader, sending a full tablet report...
I20260619 04:42:18.415757 22643 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:41505
I20260619 04:42:18.415845 22779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:41505 every 8 connection(s)
I20260619 04:42:18.417501 22643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:42:18.425225 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 22643
I20260619 04:42:18.425437 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:42:18.426003 10113 external_mini_cluster.cc:1428] Setting key 5ad1edcedb61420293c780d6e366c43c
Jun 19 04:42:18 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844137, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:18.444131 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:18.420509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:45181 (local address 127.9.224.126:40731)
0619 04:42:18.421053 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:18.421057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:18.422223 (+ 1166us) server_negotiation.cc:407] Connection header received
0619 04:42:18.424149 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:18.424155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:18.424253 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:18.424373 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:18.426662 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:18.427655 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:18.430105 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:18.430783 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:18.430930 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:18.435900 (+ 4970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:18.435908 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:18.435913 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:18.435959 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:18.439866 (+ 3907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:18.440997 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:18.441004 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:18.441008 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:18.441178 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:18.441768 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:18.441774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:18.441777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:18.442164 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:18.442368 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:18.443451 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0619 04:42:18.443719 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":296,"threads_started":1}
I20260619 04:42:18.445649 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:18.421237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40731 (local address 127.9.224.66:45181)
0619 04:42:18.422018 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:18.422064 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:18.423850 (+ 1786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:18.424644 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:18.424653 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:18.425320 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:18.426381 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:18.426432 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:18.427823 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:18.427835 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:18.429890 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:18.429922 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:18.431061 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:18.431071 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:18.431413 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:18.432300 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:18.432338 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:18.435571 (+ 3233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:18.440077 (+ 4506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:18.440091 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:18.440115 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:18.440813 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:18.441319 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:18.441328 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:18.441335 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:18.441622 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:18.442345 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:18.442357 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:18.442898 (+ 541us) client_negotiation.cc:769] Sending connection context
0619 04:42:18.443265 (+ 367us) client_negotiation.cc:240] Negotiation successful
0619 04:42:18.443953 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":314,"threads_started":1}
I20260619 04:42:18.447727 22780 heartbeater.cc:347] Connected to a master server at 127.9.224.126:40731
I20260619 04:42:18.448089 22780 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:18.448997 22780 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:18.450845 22424 ts_manager.cc:194] Registered new tserver with Master: e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505)
I20260619 04:42:18.452165 22424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:45181
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:42:18.486074 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:40731
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:18.835983 22786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:18.836306 22786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:18.836410 22786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:18.844213 22786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:18.844347 22786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:18.844463 22786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:42:18.854818 22786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.224.84:52021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:40731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:18.856249 22786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:18.857787 22786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:18.872222 22791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:18.872278 22794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:18.872282 22792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:18.873178 22786 server_base.cc:1034] running on GCE node
I20260619 04:42:18.873759 22786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:18.874801 22786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:18.876051 22786 hybrid_clock.cc:648] HybridClock initialized: now 1781844138875971 us; error 64 us; skew 500 ppm
I20260619 04:42:18.876364 22786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:18 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844138, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:18.879730 22786 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:42:18.881309 22786 webserver.cc:460] Webserver started at http://127.9.224.67:37805/ using document root <none> and password file <none>
I20260619 04:42:18.881985 22786 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:18.882083 22786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:18.882406 22786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 04:42:18 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844138, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:18.899183 22786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "a943cdb7423548ebb59c4364f14c944f"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "b83812fd00e548e3d6e187f0e55c13b1"
server_key_iv: "704d99c5f6c17c92d76df5f05f1b2b95"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:18.900345 22786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "a943cdb7423548ebb59c4364f14c944f"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "b83812fd00e548e3d6e187f0e55c13b1"
server_key_iv: "704d99c5f6c17c92d76df5f05f1b2b95"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:18.907819 22786 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260619 04:42:18.926594 22801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:18.928189 22786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:42:18.928342 22786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "a943cdb7423548ebb59c4364f14c944f"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "b83812fd00e548e3d6e187f0e55c13b1"
server_key_iv: "704d99c5f6c17c92d76df5f05f1b2b95"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:18.928551 22786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:18.958058 22786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:18.962639 22786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:18.962909 22786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:18.963863 22786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:18.965236 22786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:18.965309 22786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:18.965392 22786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:18.965468 22786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:19.000066 22786 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33701
I20260619 04:42:19.000105 22913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33701 every 8 connection(s)
I20260619 04:42:19.001387 22786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:42:19.011745 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 22786
I20260619 04:42:19.011925 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:42:19.012480 10113 external_mini_cluster.cc:1428] Setting key 921238d72acf62c9fccbaddacf76399b
Jun 19 04:42:19 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844138, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:19.022120 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:19.004159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:53393 (local address 127.9.224.126:40731)
0619 04:42:19.004647 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:19.004651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:19.005796 (+ 1145us) server_negotiation.cc:407] Connection header received
0619 04:42:19.007621 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:19.007627 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:19.007719 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:19.007838 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:19.009233 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.009992 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.011705 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.012317 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.012455 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:19.016481 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:19.016486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:19.016490 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:19.016522 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:19.019199 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.019929 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.019957 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.019960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.020092 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.020545 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.020550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.020552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.020833 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:19.020955 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:19.021664 (+ 709us) server_negotiation.cc:299] Negotiation successful
0619 04:42:19.021843 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":237,"threads_started":1}
I20260619 04:42:19.023052 22917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:19.004790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40731 (local address 127.9.224.67:53393)
0619 04:42:19.005617 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:19.005660 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:19.007344 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:19.008070 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:19.008078 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:19.008506 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:19.009067 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:19.009083 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.010151 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.010163 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:19.011545 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:19.011564 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.012540 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.012547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:19.012795 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:19.013500 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:19.013523 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:19.016276 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:19.019332 (+ 3056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:19.019339 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:19.019352 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:19.019785 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:19.020191 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:19.020194 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:19.020197 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:19.020394 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:19.020943 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:19.020949 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:19.021272 (+ 323us) client_negotiation.cc:769] Sending connection context
0619 04:42:19.021495 (+ 223us) client_negotiation.cc:240] Negotiation successful
0619 04:42:19.021888 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":361,"threads_started":1}
I20260619 04:42:19.024466 22914 heartbeater.cc:347] Connected to a master server at 127.9.224.126:40731
I20260619 04:42:19.024801 22914 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:19.025545 22914 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:19.027235 22424 ts_manager.cc:194] Registered new tserver with Master: a943cdb7423548ebb59c4364f14c944f (127.9.224.67:33701)
I20260619 04:42:19.028352 22424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:53393
I20260619 04:42:19.028609 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:42:19.030480 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 22504
Jun 19 04:42:19 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:42:19.047192 22919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:19.031366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53510 (local address 127.9.224.65:34587)
0619 04:42:19.031973 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:19.031979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:19.032003 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:42:19.032056 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:19.032061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:19.032305 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:19.032430 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:19.033982 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.035044 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.036426 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.037026 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.037128 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:19.041519 (+ 4391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:19.041534 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:19.041552 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:19.041588 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:19.044529 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.045224 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.045232 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.045234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.045385 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.045794 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.045797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.045799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.046161 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:19.046515 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:19.046710 (+ 195us) server_negotiation.cc:299] Negotiation successful
0619 04:42:19.046911 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":332,"threads_started":1}
I20260619 04:42:19.048633 22632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:19.132792 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 22504
I20260619 04:42:19.149021 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 22643
Jun 19 04:42:19 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:42:19.166818 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:19.149957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56936 (local address 127.9.224.66:41505)
0619 04:42:19.150487 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:19.150495 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:19.150519 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:42:19.150586 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:19.150592 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:19.150799 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:19.150999 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:19.152428 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.153455 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.155110 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.155694 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.155857 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:19.160629 (+ 4772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:19.160644 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:19.160659 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:19.160698 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:19.163686 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.164420 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.164435 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.164437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.164583 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.164972 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.164982 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.164984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.165333 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:19.165668 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:19.166031 (+ 363us) server_negotiation.cc:299] Negotiation successful
0619 04:42:19.166455 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":306,"threads_started":1}
I20260619 04:42:19.168105 22775 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:19.249840 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 22643
I20260619 04:42:19.265933 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 22786
Jun 19 04:42:19 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:42:19.282958 22923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:19.266953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48458 (local address 127.9.224.67:33701)
0619 04:42:19.267548 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:19.267555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:19.267586 (+ 31us) server_negotiation.cc:407] Connection header received
0619 04:42:19.267645 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:19.267651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:19.267896 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:19.268060 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:19.269250 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.270395 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.271632 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:19.272223 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:19.272323 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:19.277074 (+ 4751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:19.277087 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:19.277102 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:19.277138 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:19.280080 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.280764 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.280772 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.280774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.280914 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:19.281299 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:19.281304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:19.281306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:19.281708 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:19.281978 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:19.282217 (+ 239us) server_negotiation.cc:299] Negotiation successful
0619 04:42:19.282591 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":274,"threads_started":1}
I20260619 04:42:19.284278 22909 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:19.367647 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 22786
I20260619 04:42:19.383584 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 22392
I20260619 04:42:19.384943 22454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:19.496630 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 22392
I20260619 04:42:19.519138 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40731
--webserver_interface=127.9.224.126
--webserver_port=33047
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:40731
--ranger_config_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:19.849797 22926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:19.850090 22926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:19.850271 22926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:19.857597 22926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:19.857721 22926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:19.857831 22926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:19.857949 22926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:19.858006 22926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:19.868893 22926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:40731
--ranger_config_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:40731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=33047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:19.870335 22926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:19.871734 22926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:19.884377 22934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:19.884346 22932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:19.884486 22931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:19.885250 22926 server_base.cc:1034] running on GCE node
I20260619 04:42:19.886344 22926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:19.888000 22926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:19.889278 22926 hybrid_clock.cc:648] HybridClock initialized: now 1781844139889231 us; error 63 us; skew 500 ppm
I20260619 04:42:19.889706 22926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:19 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844139, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:19.893246 22926 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:19.895045 22926 webserver.cc:460] Webserver started at http://127.9.224.126:33047/ using document root <none> and password file <none>
I20260619 04:42:19.895767 22926 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:19.895923 22926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 04:42:19 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844139, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:19.984598 22926 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 04:42:19.988292 22942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:19.990000 22926 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260619 04:42:19.990279 22926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "031c3a3f7dc64333972a89740ebb58f9"
format_stamp: "Formatted at 2026-06-19 04:42:15 on dist-test-slave-9dgf"
server_key: "2d2abededc0ab709c8d472dd542a8a02"
server_key_iv: "4ff56e056f0227a69ad4abfdf5422110"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:19.991415 22926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:20.016469 22926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:20.021631 22926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:20.022017 22926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:20.042845 22926 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:40731
I20260619 04:42:20.042861 22993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:40731 every 8 connection(s)
I20260619 04:42:20.044662 22926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:20.052567 22994 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:42:20.055025 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 22926
I20260619 04:42:20.055969 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:34587
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:40731
--webserver_port=38871
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:42:20.056389 22994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Bootstrap starting.
I20260619 04:42:20.076849 22994 log.cc:824] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:20.086977 22994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:42:20.087579 22994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Bootstrap complete.
I20260619 04:42:20.097472 22994 raft_consensus.cc:348] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:20.098585 22994 raft_consensus.cc:729] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 031c3a3f7dc64333972a89740ebb58f9, State: Initialized, Role: FOLLOWER
I20260619 04:42:20.099275 22994 consensus_queue.cc:260] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:20.099538 22994 raft_consensus.cc:388] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:20.099680 22994 raft_consensus.cc:482] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:20.099892 22994 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 1 FOLLOWER]: Advancing to term 2
I20260619 04:42:20.104112 22994 raft_consensus.cc:504] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:20.104701 22994 leader_election.cc:302] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 031c3a3f7dc64333972a89740ebb58f9; no voters:
I20260619 04:42:20.105386 22994 leader_election.cc:288] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 04:42:20.105538 22998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 04:42:20.106812 22998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [term 2 LEADER]: Becoming Leader. State: Replica: 031c3a3f7dc64333972a89740ebb58f9, State: Running, Role: LEADER
I20260619 04:42:20.107472 22998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } }
I20260619 04:42:20.107836 22994 sys_catalog.cc:564] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:20.110348 22999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "031c3a3f7dc64333972a89740ebb58f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } } }
I20260619 04:42:20.110895 22999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:20.113303 23000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 031c3a3f7dc64333972a89740ebb58f9. Latest consensus state: current_term: 2 leader_uuid: "031c3a3f7dc64333972a89740ebb58f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "031c3a3f7dc64333972a89740ebb58f9" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 40731 } } }
I20260619 04:42:20.113809 23000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:20.115723 23003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:20.123370 23003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:20.125171 23003 catalog_manager.cc:1259] Loaded cluster ID: 02abcedefd994c76b76a2417742d9167
I20260619 04:42:20.125356 23003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:20.125514 22994 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 04:42:20.130481 23003 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:20.132656 23003 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Loaded TSK: 0
I20260619 04:42:20.134841 23003 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 04:42:20.534134 22996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:20.534665 22996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:20.534857 22996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:20.547102 22996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:20.547345 22996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:20.547580 22996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:42:20.564440 22996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:34587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=38871
--tserver_master_addrs=127.9.224.126:40731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:20.566597 22996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:20.568571 22996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:20.603106 23032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:20.604302 23031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:20.617168 22996 server_base.cc:1034] running on GCE node
W20260619 04:42:20.617449 23034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:20.618294 22996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:20.619709 22996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:20.621017 22996 hybrid_clock.cc:648] HybridClock initialized: now 1781844140620935 us; error 72 us; skew 500 ppm
I20260619 04:42:20.621439 22996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:20 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844140, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:20.625547 22996 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:42:20.630403 22996 webserver.cc:460] Webserver started at http://127.9.224.65:38871/ using document root <none> and password file <none>
I20260619 04:42:20.631598 22996 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:20.631789 22996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 04:42:20 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844140, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:20.673076 22996 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.000s sys 0.005s
I20260619 04:42:20.677203 23043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:20.680339 22996 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260619 04:42:20.680537 22996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "503eb09b32f64c2881f5a349cf7bf990"
format_stamp: "Formatted at 2026-06-19 04:42:16 on dist-test-slave-9dgf"
server_key: "1d89b3958bda176ffb9f98f4c9e09a7a"
server_key_iv: "40b3e12561038402bcd58884154d882e"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:20.682035 22996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:20.726625 22996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:20.731864 22996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:20.732244 22996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:20.740396 22996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:20.743343 22996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:20.743525 22996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260619 04:42:20.743677 22996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:20.743783 22996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:20.812371 22996 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:34587
I20260619 04:42:20.812456 23155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:34587 every 8 connection(s)
I20260619 04:42:20.814368 22996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:42:20.817776 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 22996
I20260619 04:42:20.818877 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:41505
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:40731
--webserver_port=45823
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:42:20 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844140, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:20.853482 23159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:20.823020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40731 (local address 127.9.224.65:50043)
0619 04:42:20.827130 (+ 4110us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:20.827209 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:20.830181 (+ 2972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:20.832713 (+ 2532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:20.832727 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:20.833422 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:20.834390 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:20.834432 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:20.836183 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:20.836188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:20.837487 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:20.837508 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:20.839397 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:20.839404 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:20.839699 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:20.840516 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:20.840548 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:20.843346 (+ 2798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:20.847941 (+ 4595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:20.847952 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:20.847969 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:20.848609 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:20.849205 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:20.849211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:20.849215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:20.849489 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:20.850544 (+ 1055us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:20.850553 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:20.851034 (+ 481us) client_negotiation.cc:769] Sending connection context
0619 04:42:20.851342 (+ 308us) client_negotiation.cc:240] Negotiation successful
0619 04:42:20.851955 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3747,"thread_start_us":7394,"threads_started":1}
I20260619 04:42:20.857167 23158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:20.822680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:50043 (local address 127.9.224.126:40731)
0619 04:42:20.830889 (+ 8209us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:20.830910 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:20.830973 (+ 63us) server_negotiation.cc:407] Connection header received
0619 04:42:20.831628 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:20.831645 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:20.832049 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:20.833605 (+ 1556us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:20.834694 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:20.836002 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:20.837653 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:20.839107 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:20.840225 (+ 1118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:20.843674 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:20.843685 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:20.843708 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:20.843760 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:20.847750 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:20.848825 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:20.848835 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:20.848845 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:20.849043 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:20.849640 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:20.849645 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:20.849649 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:20.850381 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:20.854832 (+ 4451us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:20.855233 (+ 401us) server_negotiation.cc:299] Negotiation successful
0619 04:42:20.855724 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7881,"thread_start_us":7593,"threads_started":1}
I20260619 04:42:20.860934 23156 heartbeater.cc:347] Connected to a master server at 127.9.224.126:40731
I20260619 04:42:20.861302 23156 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:20.862408 23156 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
W20260619 04:42:20.865949 23156 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:40731 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 04:42:20.866204 23156 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:20.866536 23156 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:20.867864 23156 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:20.868224 23156 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
W20260619 04:42:20.869339 23156 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 04:42:21.260578 23160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:21.261129 23160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:21.261375 23160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:21.273303 23160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:21.273545 23160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:21.273804 23160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:42:21.289234 23160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:41505
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=45823
--tserver_master_addrs=127.9.224.126:40731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:21.291105 23160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:21.292979 23160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:21.331171 23177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:21.331205 23176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:21.339303 23160 server_base.cc:1034] running on GCE node
W20260619 04:42:21.339648 23180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:21.340581 23160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:21.341969 23160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:21.343290 23160 hybrid_clock.cc:648] HybridClock initialized: now 1781844141343199 us; error 77 us; skew 500 ppm
I20260619 04:42:21.343725 23160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:21 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844141, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:21.351575 23160 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:42:21.353936 23160 webserver.cc:460] Webserver started at http://127.9.224.66:45823/ using document root <none> and password file <none>
I20260619 04:42:21.355026 23160 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:21.355207 23160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 04:42:21 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844141, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
Jun 19 04:42:21 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781844141, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:21.395512 23160 fs_manager.cc:709] Time spent opening directory manager: real 0.018s user 0.016s sys 0.000s
I20260619 04:42:21.417307 23187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:21.431938 23160 fs_manager.cc:725] Time spent opening block manager: real 0.034s user 0.002s sys 0.004s
I20260619 04:42:21.432209 23160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "e8dbac1d1377479ebae9836ed502cf75"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "70fbc7e4f14b6828b9edaafcc94cee16"
server_key_iv: "ff615527c87963eef856fe2dc61b0d5f"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:21.433979 23160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:21.499377 23160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:21.508989 23160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:21.509408 23160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:21.518057 23160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:21.526548 23160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:21.526773 23160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:21.526961 23160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:21.527112 23160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:21.762033 23160 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:41505
I20260619 04:42:21.762145 23300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:41505 every 8 connection(s)
I20260619 04:42:21.764001 23160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:42:21.767428 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23160
I20260619 04:42:21.768193 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.224.84:52021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:33701
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:40731
--webserver_port=37805
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:42:21 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844141, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:21.851130 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:21.782968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:55247 (local address 127.9.224.126:40731)
0619 04:42:21.813155 (+ 30187us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:21.813162 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:21.820414 (+ 7252us) server_negotiation.cc:407] Connection header received
0619 04:42:21.822874 (+ 2460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:21.822880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:21.822973 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:21.823055 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:21.826362 (+ 3307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:21.827526 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:21.831526 (+ 4000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:21.832231 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:21.832351 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:21.843006 (+ 10655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:21.843015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:21.843020 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:21.843101 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:21.846884 (+ 3783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:21.847991 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:21.847997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:21.848001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:21.848156 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:21.848791 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:21.848797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:21.848800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:21.849180 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:21.849323 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:21.850464 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0619 04:42:21.850732 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30017,"thread_start_us":30204,"threads_started":1}
I20260619 04:42:21.853462 23303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:21.782336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40731 (local address 127.9.224.66:55247)
0619 04:42:21.818899 (+ 36563us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:21.818955 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:21.821569 (+ 2614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:21.823669 (+ 2100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:21.823682 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:21.824297 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:21.825117 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:21.825144 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:21.827744 (+ 2600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:21.827749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:21.829860 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:21.829875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:21.832770 (+ 2895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:21.832778 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:21.833115 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:21.839711 (+ 6596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:21.839751 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:21.842647 (+ 2896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:21.847110 (+ 4463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:21.847122 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:21.847142 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:21.847815 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:21.848324 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:21.848330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:21.848334 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:21.848628 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:21.849421 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:21.849431 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:21.849931 (+ 500us) client_negotiation.cc:769] Sending connection context
0619 04:42:21.851373 (+ 1442us) client_negotiation.cc:240] Negotiation successful
0619 04:42:21.851997 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36214,"thread_start_us":39468,"threads_started":1}
I20260619 04:42:21.856364 23301 heartbeater.cc:347] Connected to a master server at 127.9.224.126:40731
I20260619 04:42:21.856707 23301 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:21.857623 23301 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:21.859961 22959 ts_manager.cc:194] Registered new tserver with Master: e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505)
I20260619 04:42:21.862327 22959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:55247
I20260619 04:42:21.869480 23156 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:21.869912 23156 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:21.871186 22959 ts_manager.cc:194] Registered new tserver with Master: 503eb09b32f64c2881f5a349cf7bf990 (127.9.224.65:34587)
I20260619 04:42:21.872220 22959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:50043
Jun 19 04:42:22 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844141, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
W20260619 04:42:22.341435 23302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:22.342013 23302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:22.342221 23302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:22.354199 23302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:22.354477 23302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:22.354710 23302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:42:22.371325 23302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.224.84:52021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:33701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=37805
--tserver_master_addrs=127.9.224.126:40731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:22.373497 23302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:22.375424 23302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Jun 19 04:42:22 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844141, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
W20260619 04:42:22.409112 23312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:22.411653 23311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:22.411921 23302 server_base.cc:1034] running on GCE node
W20260619 04:42:22.415833 23314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:22.416886 23302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:22.419934 23302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:22.421197 23302 hybrid_clock.cc:648] HybridClock initialized: now 1781844142421146 us; error 68 us; skew 500 ppm
I20260619 04:42:22.421633 23302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:22 dist-test-slave-9dgf krb5kdc[21948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844142, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:22.426154 23302 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:42:22.429701 23302 webserver.cc:460] Webserver started at http://127.9.224.67:37805/ using document root <none> and password file <none>
I20260619 04:42:22.430792 23302 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:22.430972 23302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 04:42:22 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844142, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for HTTP/127.9.224.84@KRBTEST.COM
I20260619 04:42:22.461329 23302 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260619 04:42:22.465276 23322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:22.467391 23302 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260619 04:42:22.467614 23302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "a943cdb7423548ebb59c4364f14c944f"
format_stamp: "Formatted at 2026-06-19 04:42:18 on dist-test-slave-9dgf"
server_key: "b83812fd00e548e3d6e187f0e55c13b1"
server_key_iv: "704d99c5f6c17c92d76df5f05f1b2b95"
server_key_version: "kuduclusterkey@0"
I20260619 04:42:22.469179 23302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:22.525260 23302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:22.531386 23302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:22.531724 23302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:22.533056 23302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:22.539124 23302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:22.539274 23302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:22.539399 23302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:22.539480 23302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:22.625494 23302 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33701
I20260619 04:42:22.625581 23434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33701 every 8 connection(s)
I20260619 04:42:22.627436 23302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:42:22.631541 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23302
Jun 19 04:42:22 dist-test-slave-9dgf krb5kdc[21948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844142, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:22.669456 23440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.632871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50884 (local address 127.9.224.126:40731)
0619 04:42:22.643709 (+ 10838us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.643719 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.643747 (+ 28us) server_negotiation.cc:407] Connection header received
0619 04:42:22.643852 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.643861 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.643969 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.644118 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:22.650422 (+ 6304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.652078 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.654363 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.655001 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.655148 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.659433 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:22.659440 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:22.659445 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:22.659499 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:22.663689 (+ 4190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:22.665422 (+ 1733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:22.665428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:22.665432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:22.665594 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:22.666083 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:22.666087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:22.666090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:22.666529 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:22.668610 (+ 2081us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.668764 (+ 154us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.669015 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10698,"thread_start_us":20660,"threads_started":1}
I20260619 04:42:22.673857 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.633212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:35983 (local address 127.9.224.126:40731)
0619 04:42:22.653823 (+ 20611us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.653827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.653843 (+ 16us) server_negotiation.cc:407] Connection header received
0619 04:42:22.653897 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.653900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.653974 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.654108 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:22.656556 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.657848 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.660549 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.661319 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.661474 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.666088 (+ 4614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:22.666094 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:22.666099 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:22.666137 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:22.670142 (+ 4005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:22.671157 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:22.671162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:22.671165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:22.671310 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:22.671912 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:22.671917 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:22.671920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:22.672286 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:22.672419 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.673253 (+ 834us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.673474 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20487,"thread_start_us":10209,"threads_started":1}
I20260619 04:42:22.675695 23437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.632053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:40731 (local address 127.9.224.67:35983)
0619 04:42:22.639118 (+ 7065us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.639207 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.652840 (+ 13633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.654542 (+ 1702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.654556 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.655277 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:22.656251 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.656291 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.658092 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.658099 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.660348 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.660368 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.661877 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.661886 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.662257 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.662992 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:22.663028 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:22.665782 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:22.670357 (+ 4575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:22.670371 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:22.670394 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:22.671014 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:22.671463 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:22.671468 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:22.671471 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:22.671777 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:22.672492 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:22.672500 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:22.672865 (+ 365us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.673139 (+ 274us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.673732 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6597,"thread_start_us":6308,"threads_started":1}
I20260619 04:42:22.677693 23435 heartbeater.cc:347] Connected to a master server at 127.9.224.126:40731
I20260619 04:42:22.678026 23435 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:22.679116 23435 heartbeater.cc:511] Master 127.9.224.126:40731 requested a full tablet report, sending...
I20260619 04:42:22.680755 22959 ts_manager.cc:194] Registered new tserver with Master: a943cdb7423548ebb59c4364f14c944f (127.9.224.67:33701)
I20260619 04:42:22.681704 22959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:35983
I20260619 04:42:22.686606 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:42:22.707199 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.690133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50900 (local address 127.9.224.126:40731)
0619 04:42:22.690379 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.690388 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.691368 (+ 980us) server_negotiation.cc:407] Connection header received
0619 04:42:22.691668 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.691674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.691773 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.691878 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:22.693975 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.695240 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.697257 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.697809 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.697924 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.701353 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:22.701358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:22.701362 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:22.701423 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:22.704381 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:22.705274 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:22.705278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:22.705280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:22.705420 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:22.705833 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:22.705837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:22.705839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:22.706121 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:22.706379 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.706706 (+ 327us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.706912 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:42:22.712715 22959 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:42:22.721122 22959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:42:22.775014 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.737145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:53526)
0619 04:42:22.754047 (+ 16902us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.754093 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.754337 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.757093 (+ 2756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.757101 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.757140 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.757622 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.757638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.759677 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.759682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.770600 (+ 10918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.770624 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.773838 (+ 3214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.773846 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.774104 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.774160 (+ 56us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.774318 (+ 158us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.774525 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16600,"thread_start_us":34544,"threads_started":1}
I20260619 04:42:22.776592 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.742047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53526 (local address 127.9.224.65:34587)
0619 04:42:22.755977 (+ 13930us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.755986 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.756018 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:42:22.756123 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.756131 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.756436 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.756638 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.757860 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.759500 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.771635 (+ 12135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.773246 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.773411 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.773651 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.776042 (+ 2391us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.776226 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13743,"thread_start_us":14780,"threads_started":1}
I20260619 04:42:22.781945 23457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.737145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:41505 (local address 127.0.0.1:56940)
0619 04:42:22.771503 (+ 34358us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.771531 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.772035 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.773217 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.773226 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.773277 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.773936 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.773955 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.776895 (+ 2940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.776900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.779436 (+ 2536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.779449 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.781023 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.781029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.781203 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.781253 (+ 50us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.781372 (+ 119us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.781507 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34180,"mutex_wait_us":40,"thread_start_us":41208,"threads_started":1}
I20260619 04:42:22.781945 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.742320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.9.224.66:41505)
0619 04:42:22.747048 (+ 4728us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.747062 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.771664 (+ 24602us) server_negotiation.cc:407] Connection header received
0619 04:42:22.772287 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.772300 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.772659 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.772873 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.774280 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.776268 (+ 1988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.779840 (+ 3572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.780791 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.780958 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.781205 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.781421 (+ 216us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.781592 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4506,"thread_start_us":4367,"threads_started":1}
I20260619 04:42:22.785452 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.739804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33701 (local address 127.0.0.1:48460)
0619 04:42:22.775807 (+ 36003us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.775826 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.776898 (+ 1072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.777915 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.777920 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.777947 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.778119 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.778129 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.780135 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.780140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.781991 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.782006 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.784660 (+ 2654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.784666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.784855 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.784887 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.784968 (+ 81us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.785123 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35904,"thread_start_us":13773,"threads_started":1}
I20260619 04:42:22.786356 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.740574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.9.224.67:33701)
0619 04:42:22.770107 (+ 29533us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.770120 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.775917 (+ 5797us) server_negotiation.cc:407] Connection header received
0619 04:42:22.777114 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.777124 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.777402 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.777594 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.778336 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.779955 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.782473 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.784106 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.784214 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.784469 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.785811 (+ 1342us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.785982 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29269,"thread_start_us":29561,"threads_started":1}
I20260619 04:42:22.786299 23236 tablet_service.cc:1467] Processing CreateTablet for tablet 733d4482dbac42f6b3bf38bfbf084c90 (DEFAULT_TABLE table=test-table [id=098a9de64930462997324c2b3718eef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:22.786275 23091 tablet_service.cc:1467] Processing CreateTablet for tablet 733d4482dbac42f6b3bf38bfbf084c90 (DEFAULT_TABLE table=test-table [id=098a9de64930462997324c2b3718eef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:22.787899 23236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733d4482dbac42f6b3bf38bfbf084c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:22.790527 23370 tablet_service.cc:1467] Processing CreateTablet for tablet 733d4482dbac42f6b3bf38bfbf084c90 (DEFAULT_TABLE table=test-table [id=098a9de64930462997324c2b3718eef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:22.791977 23370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733d4482dbac42f6b3bf38bfbf084c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:22.792371 23091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 733d4482dbac42f6b3bf38bfbf084c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:22.809351 23463 tablet_bootstrap.cc:492] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Bootstrap starting.
I20260619 04:42:22.816087 23463 tablet_bootstrap.cc:654] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:22.817219 23464 tablet_bootstrap.cc:492] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Bootstrap starting.
I20260619 04:42:22.822258 23464 tablet_bootstrap.cc:654] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:22.823173 23463 log.cc:824] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:22.823973 23464 log.cc:824] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:22.824767 23465 tablet_bootstrap.cc:492] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: Bootstrap starting.
I20260619 04:42:22.829438 23465 tablet_bootstrap.cc:654] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:22.830659 23464 tablet_bootstrap.cc:492] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: No bootstrap required, opened a new log
I20260619 04:42:22.830823 23465 log.cc:824] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:22.831028 23464 ts_tablet_manager.cc:1397] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.007s
I20260619 04:42:22.831312 23463 tablet_bootstrap.cc:492] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: No bootstrap required, opened a new log
I20260619 04:42:22.831698 23463 ts_tablet_manager.cc:1397] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.000s
I20260619 04:42:22.840752 23465 tablet_bootstrap.cc:492] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: No bootstrap required, opened a new log
I20260619 04:42:22.841192 23465 ts_tablet_manager.cc:1397] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.005s
I20260619 04:42:22.842499 23464 raft_consensus.cc:348] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.842499 23463 raft_consensus.cc:348] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.842969 23463 raft_consensus.cc:374] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:22.843088 23463 raft_consensus.cc:729] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8dbac1d1377479ebae9836ed502cf75, State: Initialized, Role: FOLLOWER
I20260619 04:42:22.843132 23464 raft_consensus.cc:374] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:22.843320 23464 raft_consensus.cc:729] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a943cdb7423548ebb59c4364f14c944f, State: Initialized, Role: FOLLOWER
I20260619 04:42:22.843858 23463 consensus_queue.cc:260] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.844077 23464 consensus_queue.cc:260] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.850010 23464 ts_tablet_manager.cc:1428] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Time spent starting tablet: real 0.019s user 0.008s sys 0.008s
I20260619 04:42:22.850668 23435 heartbeater.cc:503] Master 127.9.224.126:40731 was elected leader, sending a full tablet report...
I20260619 04:42:22.852099 23465 raft_consensus.cc:348] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.852630 23465 raft_consensus.cc:374] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:22.852768 23465 raft_consensus.cc:729] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503eb09b32f64c2881f5a349cf7bf990, State: Initialized, Role: FOLLOWER
I20260619 04:42:22.853750 23465 consensus_queue.cc:260] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.861163 23301 heartbeater.cc:503] Master 127.9.224.126:40731 was elected leader, sending a full tablet report...
I20260619 04:42:22.861927 23465 ts_tablet_manager.cc:1428] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: Time spent starting tablet: real 0.021s user 0.015s sys 0.003s
I20260619 04:42:22.861956 23463 ts_tablet_manager.cc:1428] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Time spent starting tablet: real 0.030s user 0.023s sys 0.004s
I20260619 04:42:22.862303 23156 heartbeater.cc:503] Master 127.9.224.126:40731 was elected leader, sending a full tablet report...
W20260619 04:42:22.881422 23436 tablet.cc:2369] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:42:22.909284 23471 raft_consensus.cc:482] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:42:22.909619 23471 raft_consensus.cc:504] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.911605 23471 leader_election.cc:288] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505), a943cdb7423548ebb59c4364f14c944f (127.9.224.67:33701)
I20260619 04:42:22.913486 23470 raft_consensus.cc:482] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:42:22.913977 23470 raft_consensus.cc:504] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.922595 23470 leader_election.cc:288] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505), 503eb09b32f64c2881f5a349cf7bf990 (127.9.224.65:34587)
I20260619 04:42:22.943472 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.912238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:57591 (local address 127.9.224.66:41505)
0619 04:42:22.912663 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.912673 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.933098 (+ 20425us) server_negotiation.cc:407] Connection header received
0619 04:42:22.933220 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.933230 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.933335 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.933452 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.934985 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.936412 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.941050 (+ 4638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.942318 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.942471 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.942543 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.943057 (+ 514us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.943198 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229}
I20260619 04:42:22.944268 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.911971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:41505 (local address 127.9.224.65:57591)
0619 04:42:22.932621 (+ 20650us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.932640 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.932742 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.933541 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.933545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.933585 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.934516 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.934529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.936941 (+ 2412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.936950 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.940770 (+ 3820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.940792 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.942682 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.942688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.942859 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.942895 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.943665 (+ 770us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.943821 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20512,"mutex_wait_us":2037,"spinlock_wait_cycles":49920,"thread_start_us":19748,"threads_started":1}
I20260619 04:42:22.945597 23256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "503eb09b32f64c2881f5a349cf7bf990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8dbac1d1377479ebae9836ed502cf75" is_pre_election: true
I20260619 04:42:22.946205 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.932620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:52351 (local address 127.9.224.65:34587)
0619 04:42:22.933129 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.933135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.934894 (+ 1759us) server_negotiation.cc:407] Connection header received
0619 04:42:22.935950 (+ 1056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.935956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.936081 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.936145 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.937871 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.939076 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.943686 (+ 4610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.945006 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.945143 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.945217 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.945822 (+ 605us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.945956 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":389}
I20260619 04:42:22.946161 23256 raft_consensus.cc:2454] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503eb09b32f64c2881f5a349cf7bf990 in term 0.
I20260619 04:42:22.946908 23437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.916750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:41505 (local address 127.9.224.67:34545)
0619 04:42:22.917180 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.917201 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.917334 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.938586 (+ 21252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.938595 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.938628 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.938838 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.938848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.940653 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.940659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.943603 (+ 2944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.943617 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.946079 (+ 2462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.946085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.946312 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.946347 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.946424 (+ 77us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.946631 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":452}
I20260619 04:42:22.947204 23044 leader_election.cc:302] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503eb09b32f64c2881f5a349cf7bf990, e8dbac1d1377479ebae9836ed502cf75; no voters:
I20260619 04:42:22.947415 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.912983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:45893 (local address 127.9.224.67:33701)
0619 04:42:22.913193 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.913199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.932358 (+ 19159us) server_negotiation.cc:407] Connection header received
0619 04:42:22.932711 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.932718 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.932805 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.932878 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.934427 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.935732 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.940109 (+ 4377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.942324 (+ 2215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.942483 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.942553 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.946674 (+ 4121us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.946800 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":114,"server-negotiator.queue_time_us":51}
I20260619 04:42:22.947667 23471 raft_consensus.cc:2781] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:42:22.947818 23471 raft_consensus.cc:482] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:42:22.947899 23471 raft_consensus.cc:3037] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:22.948077 23473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.911966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33701 (local address 127.9.224.65:45893)
0619 04:42:22.932171 (+ 20205us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.932207 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.932511 (+ 304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.933657 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.933661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.933701 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.934166 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.934184 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.935938 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.935944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.939929 (+ 3985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.939946 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.945671 (+ 5725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.945677 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.945882 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.945914 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.946946 (+ 1032us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.947103 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20018,"mutex_wait_us":5,"thread_start_us":20295,"threads_started":1}
I20260619 04:42:22.948486 23475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.917770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:34545 (local address 127.9.224.66:41505)
0619 04:42:22.937485 (+ 19715us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.937491 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.937514 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:42:22.937572 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.937577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.937643 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.938993 (+ 1350us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:22.939281 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.940493 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.944089 (+ 3596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.945460 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.947936 (+ 2476us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.948004 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.948050 (+ 46us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.948173 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19550,"thread_start_us":19927,"threads_started":1}
I20260619 04:42:22.949023 23256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "a943cdb7423548ebb59c4364f14c944f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8dbac1d1377479ebae9836ed502cf75" is_pre_election: true
I20260619 04:42:22.949255 23256 raft_consensus.cc:2454] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a943cdb7423548ebb59c4364f14c944f in term 0.
I20260619 04:42:22.949131 23390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "503eb09b32f64c2881f5a349cf7bf990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a943cdb7423548ebb59c4364f14c944f" is_pre_election: true
I20260619 04:42:22.949589 23390 raft_consensus.cc:2454] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503eb09b32f64c2881f5a349cf7bf990 in term 0.
I20260619 04:42:22.949811 23323 leader_election.cc:302] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a943cdb7423548ebb59c4364f14c944f, e8dbac1d1377479ebae9836ed502cf75; no voters:
I20260619 04:42:22.950273 23470 raft_consensus.cc:2781] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:42:22.950433 23470 raft_consensus.cc:482] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:42:22.950537 23470 raft_consensus.cc:3037] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:22.951171 23474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.916900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.9.224.67:52351)
0619 04:42:22.934786 (+ 17886us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:22.934806 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:22.935588 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:22.936357 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:22.936362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:22.936414 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:22.936731 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.936741 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.939255 (+ 2514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.939260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.943487 (+ 4227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:22.943502 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.945418 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.945426 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:22.945625 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.945668 (+ 43us) client_negotiation.cc:769] Sending connection context
0619 04:42:22.946418 (+ 750us) client_negotiation.cc:240] Negotiation successful
0619 04:42:22.948990 (+ 2572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17738,"mutex_wait_us":2379,"thread_start_us":17702,"threads_started":1}
I20260619 04:42:22.951112 23471 raft_consensus.cc:504] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.952142 23471 leader_election.cc:288] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [CANDIDATE]: Term 1 election: Requested vote from peers e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505), a943cdb7423548ebb59c4364f14c944f (127.9.224.67:33701)
I20260619 04:42:22.952661 23256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "503eb09b32f64c2881f5a349cf7bf990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8dbac1d1377479ebae9836ed502cf75"
I20260619 04:42:22.952844 23390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "503eb09b32f64c2881f5a349cf7bf990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a943cdb7423548ebb59c4364f14c944f"
I20260619 04:42:22.952886 23256 raft_consensus.cc:3037] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:22.952265 23111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "a943cdb7423548ebb59c4364f14c944f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503eb09b32f64c2881f5a349cf7bf990" is_pre_election: true
I20260619 04:42:22.953465 23111 raft_consensus.cc:2379] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a943cdb7423548ebb59c4364f14c944f in current term 1: Already voted for candidate 503eb09b32f64c2881f5a349cf7bf990 in this term.
I20260619 04:42:22.953735 23470 raft_consensus.cc:504] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.954166 23390 raft_consensus.cc:2379] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 503eb09b32f64c2881f5a349cf7bf990 in current term 1: Already voted for candidate a943cdb7423548ebb59c4364f14c944f in this term.
I20260619 04:42:22.954658 23470 leader_election.cc:288] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [CANDIDATE]: Term 1 election: Requested vote from peers e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505), 503eb09b32f64c2881f5a349cf7bf990 (127.9.224.65:34587)
I20260619 04:42:22.955194 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "a943cdb7423548ebb59c4364f14c944f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8dbac1d1377479ebae9836ed502cf75"
I20260619 04:42:22.956175 23256 raft_consensus.cc:2454] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503eb09b32f64c2881f5a349cf7bf990 in term 1.
I20260619 04:42:22.956578 23044 leader_election.cc:302] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503eb09b32f64c2881f5a349cf7bf990, e8dbac1d1377479ebae9836ed502cf75; no voters:
I20260619 04:42:22.956875 23471 raft_consensus.cc:2781] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:22.957050 23111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "733d4482dbac42f6b3bf38bfbf084c90" candidate_uuid: "a943cdb7423548ebb59c4364f14c944f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "503eb09b32f64c2881f5a349cf7bf990"
I20260619 04:42:22.957731 23471 raft_consensus.cc:686] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 1 LEADER]: Becoming Leader. State: Replica: 503eb09b32f64c2881f5a349cf7bf990, State: Running, Role: LEADER
I20260619 04:42:22.958536 23471 consensus_queue.cc:237] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } }
I20260619 04:42:22.963197 23325 leader_election.cc:302] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a943cdb7423548ebb59c4364f14c944f; no voters: 503eb09b32f64c2881f5a349cf7bf990, e8dbac1d1377479ebae9836ed502cf75
I20260619 04:42:22.963596 23470 raft_consensus.cc:2726] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 04:42:22.964455 22959 catalog_manager.cc:5495] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503eb09b32f64c2881f5a349cf7bf990 (127.9.224.65). New cstate: current_term: 1 leader_uuid: "503eb09b32f64c2881f5a349cf7bf990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "503eb09b32f64c2881f5a349cf7bf990" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 34587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 } health_report { overall_health: UNKNOWN } } }
I20260619 04:42:22.998446 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:22.992389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53538 (local address 127.9.224.65:34587)
0619 04:42:22.992560 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:22.992566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:22.992649 (+ 83us) server_negotiation.cc:407] Connection header received
0619 04:42:22.992905 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:22.992909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:22.993008 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:22.993165 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:42:22.993580 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.994426 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.995943 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:22.996411 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:22.996609 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:22.997214 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:42:22.997756 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:42:22.997875 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:22.998006 (+ 131us) server_negotiation.cc:299] Negotiation successful
0619 04:42:22.998087 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:42:23.007398 23256 raft_consensus.cc:1261] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 1 FOLLOWER]: Refusing update from remote peer 503eb09b32f64c2881f5a349cf7bf990: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:23.007541 23390 raft_consensus.cc:1261] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 1 FOLLOWER]: Refusing update from remote peer 503eb09b32f64c2881f5a349cf7bf990: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:23.008404 23471 consensus_queue.cc:1035] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8dbac1d1377479ebae9836ed502cf75" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 41505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:23.008778 23476 consensus_queue.cc:1035] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a943cdb7423548ebb59c4364f14c944f" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:23.024449 23479 mvcc.cc:205] Tried to move back new op lower bound from 7298433609747349504 to 7298433609562468352. Current Snapshot: MvccSnapshot[applied={T|T < 7298433609747349504}]
I20260619 04:42:23.025333 23480 mvcc.cc:205] Tried to move back new op lower bound from 7298433609747349504 to 7298433609562468352. Current Snapshot: MvccSnapshot[applied={T|T < 7298433609747349504}]
I20260619 04:42:23.052534 22958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:42:23.052870 22958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:42:23.057577 22958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 031c3a3f7dc64333972a89740ebb58f9: Sending DeleteTablet for 3 replicas of tablet 733d4482dbac42f6b3bf38bfbf084c90
I20260619 04:42:23.058861 23236 tablet_service.cc:1514] Processing DeleteTablet for tablet 733d4482dbac42f6b3bf38bfbf084c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:23 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:56940
I20260619 04:42:23.060256 23091 tablet_service.cc:1514] Processing DeleteTablet for tablet 733d4482dbac42f6b3bf38bfbf084c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:23 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:53526
I20260619 04:42:23.067528 23370 tablet_service.cc:1514] Processing DeleteTablet for tablet 733d4482dbac42f6b3bf38bfbf084c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:23 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:48460
I20260619 04:42:23.069936 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 22996
I20260619 04:42:23.079814 23491 tablet_replica.cc:330] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: stopping tablet replica
I20260619 04:42:23.080307 23491 raft_consensus.cc:2229] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:42:23.080878 23491 raft_consensus.cc:2258] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:23.082836 23490 tablet_replica.cc:330] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: stopping tablet replica
I20260619 04:42:23.083274 23490 raft_consensus.cc:2229] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:42:23.083933 23490 raft_consensus.cc:2258] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:23.086153 23491 ts_tablet_manager.cc:1905] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:23.095142 23490 ts_tablet_manager.cc:1905] T 733d4482dbac42f6b3bf38bfbf084c90 P 503eb09b32f64c2881f5a349cf7bf990: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:23.095554 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.073577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.9.224.65:34587)
0619 04:42:23.073814 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:23.073820 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:23.073840 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:42:23.073906 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:23.073911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:23.074013 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:23.074145 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:23.077823 (+ 3678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:23.079062 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:23.081753 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:23.082504 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:23.082641 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:23.087807 (+ 5166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:23.087819 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:23.087837 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:23.087880 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:23.092007 (+ 4127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:23.093094 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:23.093104 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:23.093113 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:23.093273 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:23.093684 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:23.093699 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:23.093704 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:23.094176 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:23.094597 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:23.094907 (+ 310us) server_negotiation.cc:299] Negotiation successful
0619 04:42:23.095144 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:42:23.096426 23151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:23.097225 23489 tablet_replica.cc:330] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: stopping tablet replica
I20260619 04:42:23.097842 23489 raft_consensus.cc:2229] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:42:23.098604 23489 raft_consensus.cc:2258] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:23.100898 23489 ts_tablet_manager.cc:1905] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:23.102478 23491 ts_tablet_manager.cc:1918] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:23.102643 23491 log.cc:1196] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/733d4482dbac42f6b3bf38bfbf084c90
I20260619 04:42:23.103147 23491 ts_tablet_manager.cc:1939] T 733d4482dbac42f6b3bf38bfbf084c90 P a943cdb7423548ebb59c4364f14c944f: Deleting consensus metadata
I20260619 04:42:23.105104 22946 catalog_manager.cc:4841] TS a943cdb7423548ebb59c4364f14c944f (127.9.224.67:33701): tablet 733d4482dbac42f6b3bf38bfbf084c90 (table test-table [id=098a9de64930462997324c2b3718eef7]) successfully deleted
I20260619 04:42:23.110387 23489 ts_tablet_manager.cc:1918] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:23.110569 23489 log.cc:1196] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/733d4482dbac42f6b3bf38bfbf084c90
I20260619 04:42:23.111150 23489 ts_tablet_manager.cc:1939] T 733d4482dbac42f6b3bf38bfbf084c90 P e8dbac1d1377479ebae9836ed502cf75: Deleting consensus metadata
I20260619 04:42:23.113185 22943 catalog_manager.cc:4841] TS e8dbac1d1377479ebae9836ed502cf75 (127.9.224.66:41505): tablet 733d4482dbac42f6b3bf38bfbf084c90 (table test-table [id=098a9de64930462997324c2b3718eef7]) successfully deleted
I20260619 04:42:23.199570 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 22996
W20260619 04:42:23.218019 22945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.224.65:34587 (error 108)
I20260619 04:42:23.219190 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23160
I20260619 04:42:23.219744 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.219198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:53564)
0619 04:42:23.219404 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.219527 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260619 04:42:23.220029 22945 catalog_manager.cc:4584] TS 503eb09b32f64c2881f5a349cf7bf990 (127.9.224.65:34587): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 733d4482dbac42f6b3bf38bfbf084c90: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
I20260619 04:42:23.232839 23475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.220066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56950 (local address 127.9.224.66:41505)
0619 04:42:23.220262 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:23.220268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:23.220295 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:42:23.220422 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:23.220426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:23.220498 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:23.220589 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:23.221838 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:23.222826 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:23.224171 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:23.224573 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:23.224670 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:23.227206 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:23.227221 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:23.227237 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:23.227289 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:23.230213 (+ 2924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:23.230969 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:23.230976 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:23.230979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:23.231112 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:23.231447 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:23.231450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:23.231452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:23.231815 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:23.232042 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:23.232287 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 04:42:23.232481 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 04:42:23.233572 23296 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:23.273620 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.273137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:53570)
0619 04:42:23.273371 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.273474 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260619 04:42:23.274902 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.274476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:53578)
0619 04:42:23.274626 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.274736 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 04:42:23.326565 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23160
I20260619 04:42:23.335659 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.335038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:53584)
0619 04:42:23.335310 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.335441 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 04:42:23.336895 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.336383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:53588)
0619 04:42:23.336589 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.336691 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260619 04:42:23.343870 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23302
I20260619 04:42:23.357342 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.344737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48470 (local address 127.9.224.67:33701)
0619 04:42:23.344925 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:23.344929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:23.344948 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:42:23.345042 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:23.345046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:23.345107 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:23.345223 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:23.346558 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:23.347321 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:23.348567 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:23.348972 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:23.349067 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:23.351609 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:23.351625 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:23.351643 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:23.351688 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:23.354710 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:23.355365 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:23.355373 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:23.355375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:23.355505 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:23.355831 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:23.355835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:23.355837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:23.356196 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:23.356449 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:23.356763 (+ 314us) server_negotiation.cc:299] Negotiation successful
0619 04:42:23.356939 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 04:42:23.358121 23430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:23.417615 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.417153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:45304)
0619 04:42:23.417372 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.417471 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 04:42:23.418792 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:23.418362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:34587 (local address 127.0.0.1:45306)
0619 04:42:23.418563 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:23.418644 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260619 04:42:23.451016 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23302
I20260619 04:42:23.467284 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 22926
I20260619 04:42:23.468567 22989 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:23.581295 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 22926
I20260619 04:42:23.608003 10113 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260619 04:42:23.943920 10113 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260619 04:42:23.944111 10113 mini_ranger.cc:66] Stopping Ranger...
I20260619 04:42:24.289919 10113 mini_ranger.cc:68] Stopped Ranger
2026-06-19 04:42:24.290 UTC [21978] LOG: received smart shutdown request
2026-06-19 04:42:24.293 UTC [21978] LOG: background worker "logical replication launcher" (PID 21987) exited with exit code 1
2026-06-19 04:42:24.294 UTC [21982] LOG: shutting down
2026-06-19 04:42:24.465 UTC [21978] LOG: database system is shut down
2026-06-19T04:42:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54838 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:42:24 dist-test-slave-9dgf krb5kdc[23505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:42:24 dist-test-slave-9dgf krb5kdc[23505](info): set up 2 sockets
Jun 19 04:42:24 dist-test-slave-9dgf krb5kdc[23505](info): commencing operation
krb5kdc: starting...
W20260619 04:42:25.706673 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:42:25 dist-test-slave-9dgf krb5kdc[23505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:42:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:42:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:42:25.946651 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:39249
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:39249,127.9.224.125:39203,127.9.224.124:35629
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:26.278033 23518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:26.278465 23518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:26.278626 23518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:26.286664 23518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:26.286839 23518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:26.286976 23518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:26.287082 23518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:26.287171 23518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:26.297439 23518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:39249,127.9.224.125:39203,127.9.224.124:35629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:39249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:26.298957 23518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:26.300314 23518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:26.312263 23524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:26.312392 23526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:26.312449 23523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:26.313401 23518 server_base.cc:1034] running on GCE node
I20260619 04:42:26.314216 23518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:26.315783 23518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:26.317036 23518 hybrid_clock.cc:648] HybridClock initialized: now 1781844146316982 us; error 49 us; skew 500 ppm
I20260619 04:42:26.317495 23518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:26 dist-test-slave-9dgf krb5kdc[23505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:26.320847 23518 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:26.322479 23518 webserver.cc:460] Webserver started at http://127.9.224.126:45821/ using document root <none> and password file <none>
I20260619 04:42:26.323180 23518 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:26.323280 23518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:26.323532 23518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:26.326613 23518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "cb82546b945e4a3bb6440c7c9b5b0a53"
format_stamp: "Formatted at 2026-06-19 04:42:26 on dist-test-slave-9dgf"
server_key: "c0d075e07da9b9b21225ce36f96c25e9"
server_key_iv: "9a8686416de8435619fa3094e0b22bbe"
server_key_version: "encryptionkey@0"
I20260619 04:42:26.327394 23518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "cb82546b945e4a3bb6440c7c9b5b0a53"
format_stamp: "Formatted at 2026-06-19 04:42:26 on dist-test-slave-9dgf"
server_key: "c0d075e07da9b9b21225ce36f96c25e9"
server_key_iv: "9a8686416de8435619fa3094e0b22bbe"
server_key_version: "encryptionkey@0"
I20260619 04:42:26.332718 23518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260619 04:42:26.336329 23533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:26.337908 23518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:42:26.338099 23518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "cb82546b945e4a3bb6440c7c9b5b0a53"
format_stamp: "Formatted at 2026-06-19 04:42:26 on dist-test-slave-9dgf"
server_key: "c0d075e07da9b9b21225ce36f96c25e9"
server_key_iv: "9a8686416de8435619fa3094e0b22bbe"
server_key_version: "encryptionkey@0"
I20260619 04:42:26.338380 23518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:26.356549 23518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:26.361425 23518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:26.361770 23518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:26.381455 23518 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:39249
I20260619 04:42:26.381558 23584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:39249 every 8 connection(s)
I20260619 04:42:26.382966 23518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:26.387048 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:26.389846 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23518
I20260619 04:42:26.390115 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:42:26.390964 10113 external_mini_cluster.cc:1428] Setting key eafa5fca57839398380fe41cd3460fc3
I20260619 04:42:26.396867 23585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:42:26 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.125@KRBTEST.COM" created.
I20260619 04:42:26.421461 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.401260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50310 (local address 127.9.224.126:39249)
0619 04:42:26.402179 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:26.402200 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:26.402666 (+ 466us) server_negotiation.cc:407] Connection header received
0619 04:42:26.404753 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:26.404758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:26.405008 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:26.405225 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:26.406634 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.407870 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.409297 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.409879 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.410096 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:26.413514 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:26.413522 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:26.413536 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:26.413563 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:26.416818 (+ 3255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:26.417527 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:26.417533 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:26.417536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:26.417675 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:26.418110 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:26.418119 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:26.418123 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:26.418713 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:26.418936 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:26.419506 (+ 570us) server_negotiation.cc:299] Negotiation successful
0619 04:42:26.419946 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":668,"thread_start_us":416,"threads_started":1}
I20260619 04:42:26.421485 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.401265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:39249 (local address 127.0.0.1:50310)
0619 04:42:26.402503 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.402538 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:26.404354 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:26.405247 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:26.405254 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:26.406000 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:26.406431 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:26.406451 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.408046 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.408051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:26.409156 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:26.409168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.410135 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.410141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:26.410347 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:26.411089 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:26.411113 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:26.413257 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:26.416954 (+ 3697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:26.416968 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:26.416982 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:26.417375 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:26.417826 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:26.417832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:26.417835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:26.417996 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:26.418862 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:26.418876 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:26.419130 (+ 254us) client_negotiation.cc:769] Sending connection context
0619 04:42:26.419373 (+ 243us) client_negotiation.cc:240] Negotiation successful
0619 04:42:26.420045 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1016,"mutex_wait_us":152,"thread_start_us":774,"threads_started":1}
I20260619 04:42:26.425479 23585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:42:26.426874 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.426457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60302)
0619 04:42:26.426636 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.426749 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260619 04:42:26.427345 23536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
I20260619 04:42:26.429072 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.428685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60316)
0619 04:42:26.428853 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.428930 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260619 04:42:26.429417 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:39203: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab.
Entry for principal kudu/127.9.224.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab.
I20260619 04:42:26.448050 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:39203
--webserver_interface=127.9.224.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab
--principal=kudu/127.9.224.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:39249,127.9.224.125:39203,127.9.224.124:35629
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:42:26.478855 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } attempt: 1
I20260619 04:42:26.480149 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.479623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60326)
0619 04:42:26.479857 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.480005 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260619 04:42:26.481235 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.480878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60332)
0619 04:42:26.481032 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.481107 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 04:42:26.481438 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:39203: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
I20260619 04:42:26.549717 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } attempt: 2
I20260619 04:42:26.551045 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.550529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60348)
0619 04:42:26.550803 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.550895 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260619 04:42:26.552076 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.551702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60352)
0619 04:42:26.551853 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.551943 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 04:42:26.552265 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:39203: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
I20260619 04:42:26.643564 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } attempt: 3
I20260619 04:42:26.644804 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.644324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60368)
0619 04:42:26.644528 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.644658 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260619 04:42:26.645836 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.645454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60374)
0619 04:42:26.645610 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.645692 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:42:26.646045 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:39203: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
I20260619 04:42:26.789294 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } attempt: 4
I20260619 04:42:26.790570 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.789955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60382)
0619 04:42:26.790302 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.790395 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260619 04:42:26.791636 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.791257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60386)
0619 04:42:26.791406 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.791511 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 04:42:26.791839 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:39203: Network error: Client connection negotiation failed: client connection to 127.9.224.125:39203: connect: Connection refused (error 111)
W20260619 04:42:26.791814 23592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:26.792207 23592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:26.792376 23592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:26.799924 23592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:26.800081 23592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:26.800189 23592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:26.800302 23592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:26.800369 23592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:26.810922 23592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:39249,127.9.224.125:39203,127.9.224.124:35629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab
--principal=kudu/127.9.224.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:39203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.224.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:26.812458 23592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:26.813808 23592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:26.826020 23600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:26.826066 23598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:26.825980 23597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:26.826906 23592 server_base.cc:1034] running on GCE node
I20260619 04:42:26.827740 23592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:26.829527 23592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:26.830790 23592 hybrid_clock.cc:648] HybridClock initialized: now 1781844146830753 us; error 63 us; skew 500 ppm
I20260619 04:42:26.831249 23592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:26 dist-test-slave-9dgf krb5kdc[23505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:26.834589 23592 init.cc:377] Logged in from keytab as kudu/127.9.224.125@KRBTEST.COM (short username kudu)
I20260619 04:42:26.836324 23592 webserver.cc:460] Webserver started at http://127.9.224.125:33343/ using document root <none> and password file <none>
I20260619 04:42:26.837076 23592 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:26.837226 23592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:26.837541 23592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:26.840863 23592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data/instance:
uuid: "627d781131dd437eb66f7d5fb7407075"
format_stamp: "Formatted at 2026-06-19 04:42:26 on dist-test-slave-9dgf"
server_key: "cd6ef03381178131082f07f9fe9b3696"
server_key_iv: "45ad91a18476a6ba5812e233d4064318"
server_key_version: "encryptionkey@0"
I20260619 04:42:26.841720 23592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal/instance:
uuid: "627d781131dd437eb66f7d5fb7407075"
format_stamp: "Formatted at 2026-06-19 04:42:26 on dist-test-slave-9dgf"
server_key: "cd6ef03381178131082f07f9fe9b3696"
server_key_iv: "45ad91a18476a6ba5812e233d4064318"
server_key_version: "encryptionkey@0"
I20260619 04:42:26.847280 23592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:42:26.851034 23607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:26.852522 23592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:42:26.852723 23592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal
uuid: "627d781131dd437eb66f7d5fb7407075"
format_stamp: "Formatted at 2026-06-19 04:42:26 on dist-test-slave-9dgf"
server_key: "cd6ef03381178131082f07f9fe9b3696"
server_key_iv: "45ad91a18476a6ba5812e233d4064318"
server_key_version: "encryptionkey@0"
I20260619 04:42:26.852954 23592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:26.870733 23592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:26.875356 23592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:26.875663 23592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:26.895174 23592 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.125:39203
I20260619 04:42:26.895205 23658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.125:39203 every 8 connection(s)
I20260619 04:42:26.896703 23592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
I20260619 04:42:26.900671 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:26.903717 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23592
I20260619 04:42:26.903930 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-1/wal/instance
I20260619 04:42:26.904381 10113 external_mini_cluster.cc:1428] Setting key e744da19ab3dab1b22052dd3d4b11cbc
I20260619 04:42:26.908090 23659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:42:26 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.124@KRBTEST.COM" created.
I20260619 04:42:26.931625 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.911055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50312 (local address 127.9.224.126:39249)
0619 04:42:26.911289 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:26.911295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:26.912739 (+ 1444us) server_negotiation.cc:407] Connection header received
0619 04:42:26.914778 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:26.914788 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:26.914891 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:26.915023 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:26.916660 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.917823 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.919744 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.920587 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.920749 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:26.924712 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:26.924720 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:26.924726 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:26.924779 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:26.928046 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:26.929038 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:26.929043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:26.929045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:26.929188 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:26.929681 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:26.929685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:26.929687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:26.930047 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:26.930216 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:26.931026 (+ 810us) server_negotiation.cc:299] Negotiation successful
0619 04:42:26.931275 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 04:42:26.932664 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.911627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:39249 (local address 127.0.0.1:50312)
0619 04:42:26.912494 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.912554 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:26.914467 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:26.915267 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:26.915275 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:26.915841 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:26.916422 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:26.916439 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.918032 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.918037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:26.919559 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:26.919572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.920826 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.920831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:26.921056 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:26.921821 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:26.921845 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:26.924417 (+ 2572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:26.928308 (+ 3891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:26.928320 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:26.928342 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:26.928870 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:26.929332 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:26.929336 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:26.929338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:26.929535 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:26.930184 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:26.930193 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:26.930620 (+ 427us) client_negotiation.cc:769] Sending connection context
0619 04:42:26.930910 (+ 290us) client_negotiation.cc:240] Negotiation successful
0619 04:42:26.931477 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":385,"threads_started":1}
I20260619 04:42:26.934553 23659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:42:26 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:42:26.949656 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.935380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60396)
0619 04:42:26.935564 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.935606 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:26.935717 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:26.936496 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:26.936500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:26.936963 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:26.937095 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:26.937104 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.938525 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.938534 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:26.939382 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:26.939393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.940241 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.940246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:26.940481 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:26.941088 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:26.941107 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:26.943650 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:26.947100 (+ 3450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:26.947108 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:26.947112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:26.947662 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:26.948038 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:26.948046 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:26.948051 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:26.948242 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:26.948837 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:26.948840 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:26.948956 (+ 116us) client_negotiation.cc:769] Sending connection context
0619 04:42:26.949090 (+ 134us) client_negotiation.cc:240] Negotiation successful
0619 04:42:26.949371 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260619 04:42:26.949926 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.935517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60396 (local address 127.9.224.125:39203)
0619 04:42:26.936113 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:26.936119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:26.936142 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:42:26.936182 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:26.936187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:26.936356 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:26.936508 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:26.937244 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.938402 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.939519 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:26.940100 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:26.940235 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:26.943886 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:26.943899 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:26.943913 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:26.943948 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:26.946949 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:26.947794 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:26.947801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:26.947803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:26.947918 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:26.948344 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:26.948347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:26.948349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:26.948708 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:26.948864 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:26.949234 (+ 370us) server_negotiation.cc:299] Negotiation successful
0619 04:42:26.949498 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":445,"thread_start_us":295,"threads_started":1}
I20260619 04:42:26.952332 23659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:42:26.953619 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.953094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:39978)
0619 04:42:26.953327 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.953463 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260619 04:42:26.953917 23609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:26.955735 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:26.955370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:39984)
0619 04:42:26.955530 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:26.955616 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260619 04:42:26.955986 23659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab.
Entry for principal kudu/127.9.224.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab.
I20260619 04:42:26.957911 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:35629
--webserver_interface=127.9.224.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab
--principal=kudu/127.9.224.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:39249,127.9.224.125:39203,127.9.224.124:35629
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:42:27.005378 23659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 1
I20260619 04:42:27.006807 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.006290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:39998)
0619 04:42:27.006508 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.006640 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260619 04:42:27.007988 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.007555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40010)
0619 04:42:27.007736 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.007815 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 04:42:27.008235 23659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:27.076526 23659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 2
I20260619 04:42:27.077724 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.077259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40020)
0619 04:42:27.077474 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.077574 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 04:42:27.078778 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.078434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40024)
0619 04:42:27.078581 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.078662 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 04:42:27.079001 23659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:27.091121 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } attempt: 5
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:42:27.105057 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.091994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60398 (local address 127.9.224.125:39203)
0619 04:42:27.092202 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.092210 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.092235 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:42:27.092467 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.092472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.092560 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.092668 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.093473 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.094176 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.095496 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.095958 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.096100 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.099619 (+ 3519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.099624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.099628 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.099662 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.102392 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.103092 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.103099 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.103102 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.103227 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.103606 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.103640 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.103645 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.103925 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.104085 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.104464 (+ 379us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.104693 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 04:42:27.105053 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.091884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60398)
0619 04:42:27.092153 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.092177 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:27.092321 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:27.092702 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:27.092706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:27.093118 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:27.093295 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.093304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.094345 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.094353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.095352 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.095365 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.096114 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.096119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.096329 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.097083 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:27.097103 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:27.099414 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:27.102551 (+ 3137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.102556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.102560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.102962 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.103338 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.103343 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.103347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.103499 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.104049 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:27.104053 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:27.104211 (+ 158us) client_negotiation.cc:769] Sending connection context
0619 04:42:27.104361 (+ 150us) client_negotiation.cc:240] Negotiation successful
0619 04:42:27.104688 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 04:42:27.106346 23585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:42:27.107412 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.106969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40034)
0619 04:42:27.107185 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.107257 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260619 04:42:27.108310 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.108006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40040)
0619 04:42:27.108140 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.108222 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 04:42:27.108526 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:27.159766 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 1
I20260619 04:42:27.161129 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.160534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40056)
0619 04:42:27.160780 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.160913 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260619 04:42:27.162303 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.161845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40060)
0619 04:42:27.162007 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.162098 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:42:27.162559 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:27.170307 23659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 3
I20260619 04:42:27.171473 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.171011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40066)
0619 04:42:27.171218 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.171319 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260619 04:42:27.172608 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.172202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40082)
0619 04:42:27.172424 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.172499 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260619 04:42:27.172849 23659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:27.230806 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 2
I20260619 04:42:27.232172 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.231554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40088)
0619 04:42:27.231824 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.231955 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260619 04:42:27.233392 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.232977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40090)
0619 04:42:27.233139 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.233230 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 04:42:27.233637 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
W20260619 04:42:27.293730 23666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:27.294049 23666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:27.294143 23666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:27.301637 23666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:27.301755 23666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:27.301802 23666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:27.301852 23666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:27.301898 23666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:27.312299 23666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:39249,127.9.224.125:39203,127.9.224.124:35629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab
--principal=kudu/127.9.224.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:35629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.224.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:27.313640 23666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:27.314993 23666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 04:42:27.316118 23659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 4
I20260619 04:42:27.317384 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.316855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40102)
0619 04:42:27.317109 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.317207 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260619 04:42:27.318804 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.318441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40106)
0619 04:42:27.318612 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.318690 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260619 04:42:27.319043 23659 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
W20260619 04:42:27.327634 23671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:27.327668 23674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:27.327574 23672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:27.328562 23666 server_base.cc:1034] running on GCE node
I20260619 04:42:27.329440 23666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:27.331028 23666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:27.332238 23666 hybrid_clock.cc:648] HybridClock initialized: now 1781844147332193 us; error 34 us; skew 500 ppm
I20260619 04:42:27.332612 23666 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844147, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:27.335963 23666 init.cc:377] Logged in from keytab as kudu/127.9.224.124@KRBTEST.COM (short username kudu)
I20260619 04:42:27.337533 23666 webserver.cc:460] Webserver started at http://127.9.224.124:40583/ using document root <none> and password file <none>
I20260619 04:42:27.338330 23666 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:27.338481 23666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:27.338784 23666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:27.339872 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 3
I20260619 04:42:27.340977 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.340526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40122)
0619 04:42:27.340720 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.340808 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260619 04:42:27.342072 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.341673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40126)
0619 04:42:27.341861 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.341947 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260619 04:42:27.342290 23585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:35629: Network error: Client connection negotiation failed: client connection to 127.9.224.124:35629: connect: Connection refused (error 111)
I20260619 04:42:27.342403 23666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data/instance:
uuid: "c487cb9692ec491fb0a5ab1be41c1bfc"
format_stamp: "Formatted at 2026-06-19 04:42:27 on dist-test-slave-9dgf"
server_key: "5c46a513cb7841515a9d8362ffea5d10"
server_key_iv: "06af3a628f2ce2060089454d3f020773"
server_key_version: "encryptionkey@0"
I20260619 04:42:27.343323 23666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal/instance:
uuid: "c487cb9692ec491fb0a5ab1be41c1bfc"
format_stamp: "Formatted at 2026-06-19 04:42:27 on dist-test-slave-9dgf"
server_key: "5c46a513cb7841515a9d8362ffea5d10"
server_key_iv: "06af3a628f2ce2060089454d3f020773"
server_key_version: "encryptionkey@0"
I20260619 04:42:27.348590 23666 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:42:27.352187 23681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:27.353570 23666 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:42:27.353760 23666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal
uuid: "c487cb9692ec491fb0a5ab1be41c1bfc"
format_stamp: "Formatted at 2026-06-19 04:42:27 on dist-test-slave-9dgf"
server_key: "5c46a513cb7841515a9d8362ffea5d10"
server_key_iv: "06af3a628f2ce2060089454d3f020773"
server_key_version: "encryptionkey@0"
I20260619 04:42:27.353976 23666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:27.402012 23666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:27.406049 23666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:27.406396 23666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:27.425203 23666 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.124:35629
I20260619 04:42:27.425233 23732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.124:35629 every 8 connection(s)
I20260619 04:42:27.426620 23666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
I20260619 04:42:27.430544 23733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:27.431491 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23666
I20260619 04:42:27.431712 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781843940819459-10113-0/minicluster-data/master-2/wal/instance
I20260619 04:42:27.432190 10113 external_mini_cluster.cc:1428] Setting key 766c8f39e1526b7b70b7a948d5c0773a
I20260619 04:42:27.441021 23733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844147, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:27.460108 23736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.434448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40136 (local address 127.9.224.124:35629)
0619 04:42:27.435385 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.435401 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.435454 (+ 53us) server_negotiation.cc:407] Connection header received
0619 04:42:27.437572 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.437604 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.438197 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.438726 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.440179 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.442281 (+ 2102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.444024 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.445369 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.445504 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.450603 (+ 5099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.450612 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.450632 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.450670 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.454348 (+ 3678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.455248 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.455257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.455270 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.455472 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.455950 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.455955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.455958 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.456751 (+ 793us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.457053 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.457788 (+ 735us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.458678 (+ 890us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":423,"threads_started":1}
I20260619 04:42:27.462138 23738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.444102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50326 (local address 127.9.224.126:39249)
0619 04:42:27.445492 (+ 1390us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.445501 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.445519 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:42:27.445592 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.445597 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.445676 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.445792 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.447091 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.448416 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.450208 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.450776 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.450872 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.454835 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.454840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.454844 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.454878 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.459158 (+ 4280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.459898 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.459903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.459906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.460072 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.460534 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.460542 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.460547 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.460846 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.461016 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.461486 (+ 470us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.461723 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1253,"thread_start_us":1122,"threads_started":1}
I20260619 04:42:27.462189 23737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.444066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:39249 (local address 127.0.0.1:50326)
0619 04:42:27.444837 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.444882 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:27.445057 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:27.445856 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:27.445861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:27.446662 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:27.446925 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.446933 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.448592 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.448596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.450054 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.450066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.450955 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.450961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.451212 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.451777 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:27.451804 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:27.454640 (+ 2836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:27.459309 (+ 4669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.459317 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.459323 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.459770 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.460237 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.460241 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.460246 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.460419 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.460983 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:27.460992 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:27.461188 (+ 196us) client_negotiation.cc:769] Sending connection context
0619 04:42:27.461378 (+ 190us) client_negotiation.cc:240] Negotiation successful
0619 04:42:27.461722 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":348,"threads_started":1}
I20260619 04:42:27.464150 23733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844147, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:27.478590 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.464996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60402 (local address 127.9.224.125:39203)
0619 04:42:27.465191 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.465197 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.465216 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:42:27.465323 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.465329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.465409 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.465530 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.466454 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.467418 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.468791 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.469420 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.469577 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.472840 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.472848 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.472853 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.472898 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.475674 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.476449 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.476453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.476456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.476599 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.477035 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.477040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.477043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.477398 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.477592 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.478028 (+ 436us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.478299 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:42:27.478580 23737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.464974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:39203 (local address 127.0.0.1:60402)
0619 04:42:27.465129 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.465147 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:27.465236 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:27.465577 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:27.465581 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:27.466052 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:27.466305 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.466317 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.467572 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.467575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.468648 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.468663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.469585 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.469589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.469886 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.470470 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:27.470487 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:27.472648 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:27.475808 (+ 3160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.475815 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.475820 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.476323 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.476722 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.476727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.476731 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.476898 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.477549 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:27.477552 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:27.477735 (+ 183us) client_negotiation.cc:769] Sending connection context
0619 04:42:27.477902 (+ 167us) client_negotiation.cc:240] Negotiation successful
0619 04:42:27.478178 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 04:42:27.479768 23733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:42:27.480084 23738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.463366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50330 (local address 127.9.224.126:39249)
0619 04:42:27.463613 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.463619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.463635 (+ 16us) server_negotiation.cc:407] Connection header received
0619 04:42:27.463752 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.463756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.463837 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.463938 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.465568 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.466651 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.468278 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.468902 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.468990 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.473764 (+ 4774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.473773 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.473779 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.473821 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.476855 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.477688 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.477694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.477697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.477835 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.478318 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.478323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.478327 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.478682 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.478957 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.479577 (+ 620us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.479789 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844147, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:42:27.493362 23736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.480890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40152 (local address 127.9.224.124:35629)
0619 04:42:27.481193 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.481201 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.481221 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:42:27.481272 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.481276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.481325 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.481436 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.482304 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.482992 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.484284 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.484783 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.484870 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.488235 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.488240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.488243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.488269 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.490840 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.491423 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.491430 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.491433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.491551 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.491904 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.491909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.491912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.492172 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.492313 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.492662 (+ 349us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.493039 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":157,"server-negotiator.queue_time_us":183}
I20260619 04:42:27.493371 23737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.480591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40152)
0619 04:42:27.480771 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.480791 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:27.480890 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:27.481451 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:27.481455 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:27.481933 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:27.482118 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.482144 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.483130 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.483135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.484153 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.484165 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.484939 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.484946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.485167 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.485717 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:27.485740 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:27.488059 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:27.490966 (+ 2907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.490980 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.490984 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.491314 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.491653 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.491660 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.491663 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.491796 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.492293 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:27.492297 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:27.492437 (+ 140us) client_negotiation.cc:769] Sending connection context
0619 04:42:27.492582 (+ 145us) client_negotiation.cc:240] Negotiation successful
0619 04:42:27.492901 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260619 04:42:27.495903 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.481702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60416 (local address 127.9.224.125:39203)
0619 04:42:27.481857 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.481861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.481915 (+ 54us) server_negotiation.cc:407] Connection header received
0619 04:42:27.482079 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.482082 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.482132 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.482203 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.483574 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.484336 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.485911 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.486444 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.486563 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.490752 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.490757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.490760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.490790 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.493303 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.494038 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.494041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.494044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.494164 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.494586 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.494590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.494593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.494967 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.495220 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.495528 (+ 308us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.495686 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 04:42:27.499532 23733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: Bootstrap starting.
I20260619 04:42:27.501394 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:42:27.503161 23733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:27.504304 23733 log.cc:824] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:27.507232 23733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: No bootstrap required, opened a new log
I20260619 04:42:27.516731 23733 raft_consensus.cc:348] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.517329 23733 raft_consensus.cc:374] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:27.517534 23733 raft_consensus.cc:729] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c487cb9692ec491fb0a5ab1be41c1bfc, State: Initialized, Role: FOLLOWER
I20260619 04:42:27.518388 23733 consensus_queue.cc:260] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.519476 23585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 4
I20260619 04:42:27.533149 23738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.506376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50340 (local address 127.9.224.126:39249)
0619 04:42:27.506593 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.506599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.507682 (+ 1083us) server_negotiation.cc:407] Connection header received
0619 04:42:27.507980 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.507991 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.508110 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.508211 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.511476 (+ 3265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.512587 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.515383 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.516144 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.516265 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.520282 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.520288 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.520292 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.520350 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.524762 (+ 4412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.526587 (+ 1825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.526592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.526595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.526724 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.527110 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.527114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.527116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.527541 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.527805 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.532510 (+ 4705us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.532752 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:42:27.533927 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.507021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60420 (local address 127.9.224.125:39203)
0619 04:42:27.507557 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.507564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.513766 (+ 6202us) server_negotiation.cc:407] Connection header received
0619 04:42:27.513991 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.513999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.514092 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.514173 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.517449 (+ 3276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.518667 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.520934 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.521624 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.521723 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.526563 (+ 4840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.526569 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.526574 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.526615 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.530392 (+ 3777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.531355 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.531361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.531365 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.531519 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.532028 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.532033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.532036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.532417 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.532677 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.533309 (+ 632us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.533573 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413}
I20260619 04:42:27.533896 23747 sys_catalog.cc:455] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.534413 23747 sys_catalog.cc:458] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.535032 23736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.507701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40166 (local address 127.9.224.124:35629)
0619 04:42:27.507898 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.507904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.514172 (+ 6268us) server_negotiation.cc:407] Connection header received
0619 04:42:27.514445 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.514452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.514534 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.514598 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.516768 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.517976 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.520539 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.521299 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.521403 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.525426 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.525435 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.525441 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.525487 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.529688 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.532319 (+ 2631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.532327 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.532333 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.532560 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.533150 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.533159 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.533165 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.533599 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.533845 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.534443 (+ 598us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.534684 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 04:42:27.536710 23733 sys_catalog.cc:564] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: configured and running, proceeding with master startup.
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
W20260619 04:42:27.547857 23759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 04:42:27.548095 23759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 04:42:27.549137 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.520053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40176)
0619 04:42:27.521109 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.521144 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:27.521259 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:27.528151 (+ 6892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:27.528157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:27.528678 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:27.528905 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.528921 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.530767 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.530773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.532277 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.532291 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.536969 (+ 4678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.536976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.537175 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.537871 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:27.537895 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:27.541231 (+ 3336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:27.545970 (+ 4739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.545976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.545980 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.546595 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.547096 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.547102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.547108 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.547293 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.548082 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:27.548088 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:27.548282 (+ 194us) client_negotiation.cc:769] Sending connection context
0619 04:42:27.548425 (+ 143us) client_negotiation.cc:240] Negotiation successful
0619 04:42:27.548730 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386}
I20260619 04:42:27.549289 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.520752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40176 (local address 127.9.224.124:35629)
0619 04:42:27.526326 (+ 5574us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.526331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.526359 (+ 28us) server_negotiation.cc:407] Connection header received
0619 04:42:27.526429 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.526434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.527958 (+ 1524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.528090 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.529203 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.530603 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.535948 (+ 5345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.536766 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.536956 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.541617 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.541622 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.541626 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.541657 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.545796 (+ 4139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.546745 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.546753 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.546761 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.546945 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.547428 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.547433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.547437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.547857 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.547996 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.548601 (+ 605us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.548843 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5402,"thread_start_us":5174,"threads_started":1}
I20260619 04:42:27.551718 23747 raft_consensus.cc:482] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:42:27.552002 23747 raft_consensus.cc:504] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.553416 23747 leader_election.cc:288] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb82546b945e4a3bb6440c7c9b5b0a53 (127.9.224.126:39249), 627d781131dd437eb66f7d5fb7407075 (127.9.224.125:39203)
I20260619 04:42:27.555790 23585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: Bootstrap starting.
I20260619 04:42:27.544680 23666 master_runner.cc:186] Error getting master registration for 127.9.224.126:39249: OK, instance_id { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" instance_seqno: 1781844146375790 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 04:42:27.556807 23666 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 04:42:27.560092 23585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:27.561496 23585 log.cc:824] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:27.564785 23585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: No bootstrap required, opened a new log
I20260619 04:42:27.575815 23585 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.576252 23585 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:27.576372 23585 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb82546b945e4a3bb6440c7c9b5b0a53, State: Initialized, Role: FOLLOWER
I20260619 04:42:27.577067 23585 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.578091 23762 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.578547 23762 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.579552 23585 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:27.581688 23560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" is_pre_election: true
I20260619 04:42:27.582504 23560 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c487cb9692ec491fb0a5ab1be41c1bfc in term 0.
I20260619 04:42:27.583307 23685 leader_election.cc:302] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c487cb9692ec491fb0a5ab1be41c1bfc, cb82546b945e4a3bb6440c7c9b5b0a53; no voters:
I20260619 04:42:27.583730 23747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:42:27.583878 23747 raft_consensus.cc:482] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:42:27.583989 23747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:27.586148 23747 raft_consensus.cc:504] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.586905 23747 leader_election.cc:288] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [CANDIDATE]: Term 1 election: Requested vote from peers cb82546b945e4a3bb6440c7c9b5b0a53 (127.9.224.126:39249), 627d781131dd437eb66f7d5fb7407075 (127.9.224.125:39203)
I20260619 04:42:27.587381 23560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53"
I20260619 04:42:27.587652 23560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:27.592061 23560 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c487cb9692ec491fb0a5ab1be41c1bfc in term 1.
I20260619 04:42:27.592679 23685 leader_election.cc:302] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c487cb9692ec491fb0a5ab1be41c1bfc, cb82546b945e4a3bb6440c7c9b5b0a53; no voters:
I20260619 04:42:27.593075 23747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:27.596035 23747 raft_consensus.cc:686] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [term 1 LEADER]: Becoming Leader. State: Replica: c487cb9692ec491fb0a5ab1be41c1bfc, State: Running, Role: LEADER
I20260619 04:42:27.596690 23747 consensus_queue.cc:237] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.607995 23768 sys_catalog.cc:455] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c487cb9692ec491fb0a5ab1be41c1bfc. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.608412 23768 sys_catalog.cc:458] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: This master's current role is: LEADER
W20260619 04:42:27.613178 23775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 04:42:27.613358 23775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 04:42:27.614925 23776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260619 04:42:27.614882 23539 tablet.cc:2369] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:42:27.616585 23776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:27.618333 23659 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } attempt: 5
I20260619 04:42:27.609675 23518 master_runner.cc:186] Error getting master registration for 127.9.224.125:39203: OK, instance_id { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" instance_seqno: 1781844146889644 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 04:42:27.624167 23518 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Jun 19 04:42:27 dist-test-slave-9dgf krb5kdc[23505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844146, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
I20260619 04:42:27.638443 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.618956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:35629 (local address 127.0.0.1:40190)
0619 04:42:27.619355 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:27.619376 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:27.619495 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:27.620184 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:27.620190 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:27.620753 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:27.620960 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.620976 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.622526 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.622532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.623961 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:27.623977 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.625121 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.625128 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:27.625397 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.626216 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:27.626288 (+ 72us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:27.630272 (+ 3984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:27.634992 (+ 4720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.634998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.635003 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.635744 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.636219 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:27.636224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:27.636227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:27.636395 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:27.637210 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:27.637215 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:27.637430 (+ 215us) client_negotiation.cc:769] Sending connection context
0619 04:42:27.637601 (+ 171us) client_negotiation.cc:240] Negotiation successful
0619 04:42:27.637926 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266}
I20260619 04:42:27.639183 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:27.619320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.9.224.124:35629)
0619 04:42:27.619496 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:27.619502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:27.619526 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:42:27.619755 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:27.619760 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:27.619860 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:27.619967 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:27.621165 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.622345 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.624250 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:27.624943 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:27.625092 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:27.630560 (+ 5468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:27.630567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:27.630572 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:27.630616 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:27.634757 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.635890 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.635895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.635899 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.636064 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:27.636537 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:27.636542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:27.636545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:27.636951 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:27.637087 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:27.637939 (+ 852us) server_negotiation.cc:299] Negotiation successful
0619 04:42:27.638546 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:42:27.645534 23659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: Bootstrap starting.
I20260619 04:42:27.646948 23560 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [term 1 FOLLOWER]: Refusing update from remote peer c487cb9692ec491fb0a5ab1be41c1bfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:27.648028 23768 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:27.650173 23659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:27.651577 23659 log.cc:824] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: Log is configured to *not* fsync() on all Append() calls
W20260619 04:42:27.658603 23687 tablet.cc:2369] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:42:27.663300 23659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: No bootstrap required, opened a new log
I20260619 04:42:27.668687 23762 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c487cb9692ec491fb0a5ab1be41c1bfc. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.669060 23762 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.674983 23659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.676651 23778 mvcc.cc:205] Tried to move back new op lower bound from 7298433628725108736 to 7298433628560990208. Current Snapshot: MvccSnapshot[applied={T|T < 7298433628725108736}]
I20260619 04:42:27.677110 23747 sys_catalog.cc:455] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.677433 23747 sys_catalog.cc:458] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:27.677577 23659 raft_consensus.cc:374] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:27.677767 23659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 627d781131dd437eb66f7d5fb7407075, State: Initialized, Role: FOLLOWER
I20260619 04:42:27.678704 23659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } }
I20260619 04:42:27.680306 23762 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.680593 23762 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.680840 23780 mvcc.cc:205] Tried to move back new op lower bound from 7298433628725108736 to 7298433628560990208. Current Snapshot: MvccSnapshot[applied={T|T < 7298433628725108736}]
I20260619 04:42:27.681362 23776 catalog_manager.cc:1347] Generated new cluster ID: 56851c5cae9c471489000059942aa7ff
I20260619 04:42:27.681461 23776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:27.700166 23776 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:42:27.705703 23776 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:27.713383 23784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.715946 23784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.715803 23659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:27.716567 23632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:27.720288 23632 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 1 FOLLOWER]: Refusing update from remote peer c487cb9692ec491fb0a5ab1be41c1bfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:27.720880 23633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "627d781131dd437eb66f7d5fb7407075"
I20260619 04:42:27.723584 23776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc: Generated new TSK 0
I20260619 04:42:27.724294 23633 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c487cb9692ec491fb0a5ab1be41c1bfc in term 1.
I20260619 04:42:27.724681 23776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:42:27.715855 23634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "627d781131dd437eb66f7d5fb7407075" is_pre_election: true
I20260619 04:42:27.725235 23634 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c487cb9692ec491fb0a5ab1be41c1bfc in term 1. Re-sending same reply.
I20260619 04:42:27.726518 23747 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:27.803936 23784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c487cb9692ec491fb0a5ab1be41c1bfc. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.804291 23784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.804615 23793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:27.804952 23793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:42:27.806161 23805 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 04:42:28.180905 23747 sys_catalog.cc:455] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82546b945e4a3bb6440c7c9b5b0a53" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 39249 } } peers { permanent_uuid: "627d781131dd437eb66f7d5fb7407075" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 39203 } } peers { permanent_uuid: "c487cb9692ec491fb0a5ab1be41c1bfc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 35629 } } }
I20260619 04:42:28.181265 23747 sys_catalog.cc:458] T 00000000000000000000000000000000 P c487cb9692ec491fb0a5ab1be41c1bfc [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:28.615695 23775 catalog_manager.cc:1259] Loaded cluster ID: 56851c5cae9c471489000059942aa7ff
I20260619 04:42:28.615811 23775 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: loading cluster ID for follower catalog manager: success
I20260619 04:42:28.618898 23775 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: acquiring CA information for follower catalog manager: success
I20260619 04:42:28.620859 23775 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cb82546b945e4a3bb6440c7c9b5b0a53: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 04:42:28.810747 23805 catalog_manager.cc:1259] Loaded cluster ID: 56851c5cae9c471489000059942aa7ff
I20260619 04:42:28.810866 23805 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: loading cluster ID for follower catalog manager: success
I20260619 04:42:28.813467 23805 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: acquiring CA information for follower catalog manager: success
I20260619 04:42:28.815915 23805 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 627d781131dd437eb66f7d5fb7407075: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 04:42:28.852571 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23518
I20260619 04:42:28.853933 23580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:28.969372 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23518
I20260619 04:42:28.990872 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23592
I20260619 04:42:28.992051 23654 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:29.102217 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23592
I20260619 04:42:29.121485 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23666
I20260619 04:42:29.122908 23728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:29.234531 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23666
2026-06-19T04:42:29Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4641 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:42:29 dist-test-slave-9dgf krb5kdc[23815](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:42:29 dist-test-slave-9dgf krb5kdc[23815](info): set up 2 sockets
Jun 19 04:42:29 dist-test-slave-9dgf krb5kdc[23815](info): commencing operation
krb5kdc: starting...
W20260619 04:42:30.354797 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.005s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:42:30 dist-test-slave-9dgf krb5kdc[23815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:42:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:42:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:42:30.602123 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34799
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:34799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:30.957147 23828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:30.957479 23828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:30.957659 23828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:30.965145 23828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:30.965283 23828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:30.965399 23828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:30.965488 23828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:30.965572 23828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:30.976250 23828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:34799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:30.977783 23828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:30.979167 23828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:30.991757 23833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:30.991727 23836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:30.991655 23834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:30.992636 23828 server_base.cc:1034] running on GCE node
I20260619 04:42:30.993523 23828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:30.995169 23828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:30.996414 23828 hybrid_clock.cc:648] HybridClock initialized: now 1781844150996369 us; error 41 us; skew 500 ppm
I20260619 04:42:30.996826 23828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:30 dist-test-slave-9dgf krb5kdc[23815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844150, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:31.000079 23828 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:31.001699 23828 webserver.cc:460] Webserver started at http://127.9.224.126:36507/ using document root <none> and password file <none>
I20260619 04:42:31.002537 23828 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:31.002686 23828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:31.003011 23828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:31.006407 23828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "6f2c0262c77f460093cecdb0e1f57f4a"
format_stamp: "Formatted at 2026-06-19 04:42:31 on dist-test-slave-9dgf"
server_key: "b302857a2ab3be4028a1af7948ceffe2"
server_key_iv: "af3404fa2c78da599abbfc75cea5a5c8"
server_key_version: "encryptionkey@0"
I20260619 04:42:31.007208 23828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "6f2c0262c77f460093cecdb0e1f57f4a"
format_stamp: "Formatted at 2026-06-19 04:42:31 on dist-test-slave-9dgf"
server_key: "b302857a2ab3be4028a1af7948ceffe2"
server_key_iv: "af3404fa2c78da599abbfc75cea5a5c8"
server_key_version: "encryptionkey@0"
I20260619 04:42:31.012688 23828 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:42:31.016407 23843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:31.017863 23828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:42:31.018061 23828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "6f2c0262c77f460093cecdb0e1f57f4a"
format_stamp: "Formatted at 2026-06-19 04:42:31 on dist-test-slave-9dgf"
server_key: "b302857a2ab3be4028a1af7948ceffe2"
server_key_iv: "af3404fa2c78da599abbfc75cea5a5c8"
server_key_version: "encryptionkey@0"
I20260619 04:42:31.018311 23828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:31.055822 23828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:31.060503 23828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:31.060817 23828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:31.080708 23828 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:34799
I20260619 04:42:31.080753 23894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:34799 every 8 connection(s)
I20260619 04:42:31.082170 23828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:31.086208 23895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:31.087437 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23828
I20260619 04:42:31.087687 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:42:31.088546 10113 external_mini_cluster.cc:1428] Setting key 9928af500099946a028b855362e4d5c8
I20260619 04:42:31.099913 23895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a: Bootstrap starting.
Jun 19 04:42:31 dist-test-slave-9dgf krb5kdc[23815](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:31.103266 23895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:31.104628 23895 log.cc:824] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:31.108204 23895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a: No bootstrap required, opened a new log
I20260619 04:42:31.112218 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:31.090811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39866 (local address 127.9.224.126:34799)
0619 04:42:31.091631 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:31.091654 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:31.091702 (+ 48us) server_negotiation.cc:407] Connection header received
0619 04:42:31.093441 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:31.093469 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:31.093909 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:31.094366 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:31.095936 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:31.097277 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:31.098706 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:31.099408 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:31.099626 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:31.104217 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:31.104225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:31.104239 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:31.104284 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:31.107949 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:31.108881 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:31.108887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:31.108893 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:31.109061 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:31.109476 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:31.109479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:31.109481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:31.110009 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:31.110403 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:31.110731 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 04:42:31.111140 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":332,"threads_started":1}
I20260619 04:42:31.116302 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:42:31.117607 23895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34799 } }
I20260619 04:42:31.118085 23895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:31.118187 23895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2c0262c77f460093cecdb0e1f57f4a, State: Initialized, Role: FOLLOWER
I20260619 04:42:31.118896 23895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34799 } }
I20260619 04:42:31.119199 23895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:31.119382 23895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:31.119601 23895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:31.122007 23895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34799 } }
I20260619 04:42:31.122575 23895 leader_election.cc:302] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f2c0262c77f460093cecdb0e1f57f4a; no voters:
I20260619 04:42:31.123154 23895 leader_election.cc:288] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:42:31.123389 23900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:31.124081 23900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [term 1 LEADER]: Becoming Leader. State: Replica: 6f2c0262c77f460093cecdb0e1f57f4a, State: Running, Role: LEADER
I20260619 04:42:31.124660 23900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34799 } }
I20260619 04:42:31.125356 23895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:31.127744 23901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34799 } } }
I20260619 04:42:31.128122 23901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:31.128878 23902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f2c0262c77f460093cecdb0e1f57f4a. Latest consensus state: current_term: 1 leader_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2c0262c77f460093cecdb0e1f57f4a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34799 } } }
I20260619 04:42:31.129680 23902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:31.130261 23906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:31.136057 23906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:31.145516 23906 catalog_manager.cc:1347] Generated new cluster ID: 12206373ee7c4bf8aa496d0682fa4929
I20260619 04:42:31.145694 23906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:31.156384 23906 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:42:31.157781 23906 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:31.168323 23906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f2c0262c77f460093cecdb0e1f57f4a: Generated new TSK 0
I20260619 04:42:31.169253 23906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:42:31.177659 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23828
I20260619 04:42:31.178948 23890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:31.270586 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23828
2026-06-19T04:42:31Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2030 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:42:31 dist-test-slave-9dgf krb5kdc[23923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:42:31 dist-test-slave-9dgf krb5kdc[23923](info): set up 2 sockets
Jun 19 04:42:31 dist-test-slave-9dgf krb5kdc[23923](info): commencing operation
krb5kdc: starting...
W20260619 04:42:32.390720 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.004s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:42:32 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:42:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:42:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:42:32.643476 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38573
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:38573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:32.998621 23936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:32.998955 23936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:32.999050 23936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:33.006669 23936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:33.006791 23936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:33.006915 23936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:33.007023 23936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:33.007097 23936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:33.017365 23936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:38573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:33.018819 23936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:33.020179 23936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:33.032382 23941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:33.032411 23942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:33.032435 23944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:33.034005 23936 server_base.cc:1034] running on GCE node
I20260619 04:42:33.034929 23936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:33.036501 23936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:33.037744 23936 hybrid_clock.cc:648] HybridClock initialized: now 1781844153037694 us; error 63 us; skew 500 ppm
I20260619 04:42:33.038129 23936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:33 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844153, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:33.041617 23936 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:33.043428 23936 webserver.cc:460] Webserver started at http://127.9.224.126:40861/ using document root <none> and password file <none>
I20260619 04:42:33.044195 23936 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:33.044348 23936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:33.044678 23936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:33.048007 23936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "88d46001e501490294203af47316a2f0"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "eb9585d37df40efa5cd923581f18450b"
server_key_iv: "0fb6c69d3c312f48f77d2e140e841bf7"
server_key_version: "encryptionkey@0"
I20260619 04:42:33.048880 23936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "88d46001e501490294203af47316a2f0"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "eb9585d37df40efa5cd923581f18450b"
server_key_iv: "0fb6c69d3c312f48f77d2e140e841bf7"
server_key_version: "encryptionkey@0"
I20260619 04:42:33.054549 23936 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260619 04:42:33.058578 23951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:33.060189 23936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:42:33.060580 23936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "88d46001e501490294203af47316a2f0"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "eb9585d37df40efa5cd923581f18450b"
server_key_iv: "0fb6c69d3c312f48f77d2e140e841bf7"
server_key_version: "encryptionkey@0"
I20260619 04:42:33.060822 23936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:33.095652 23936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:33.100474 23936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:33.100781 23936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:33.120471 23936 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:38573
I20260619 04:42:33.120528 24002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:38573 every 8 connection(s)
I20260619 04:42:33.121930 23936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:33.125976 24003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:33.128502 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 23936
I20260619 04:42:33.128731 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:42:33.129599 10113 external_mini_cluster.cc:1428] Setting key c1bfaff957de24d076f3097235326f21
I20260619 04:42:33.139861 24003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap starting.
I20260619 04:42:33.144059 24003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:33.145526 24003 log.cc:824] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Log is configured to *not* fsync() on all Append() calls
Jun 19 04:42:33 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:33.149121 24003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: No bootstrap required, opened a new log
I20260619 04:42:33.157306 24006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:33.131938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40256 (local address 127.9.224.126:38573)
0619 04:42:33.132860 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:33.132873 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:33.132918 (+ 45us) server_negotiation.cc:407] Connection header received
0619 04:42:33.134804 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:33.134832 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:33.135271 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:33.135640 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:33.137580 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:33.139079 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:33.140964 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:33.141675 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:33.141827 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:33.147442 (+ 5615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:33.147452 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:33.147470 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:33.147509 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:33.151575 (+ 4066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:33.152562 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:33.152573 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:33.152583 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:33.152832 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:33.153265 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:33.153272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:33.153276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:33.154114 (+ 838us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:33.154504 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:33.155032 (+ 528us) server_negotiation.cc:299] Negotiation successful
0619 04:42:33.155607 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":431,"threads_started":1}
I20260619 04:42:33.160458 24003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:33.160928 24003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:33.161067 24003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88d46001e501490294203af47316a2f0, State: Initialized, Role: FOLLOWER
I20260619 04:42:33.161689 24003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:33.161976 24003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:33.162137 24003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:33.162365 24003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:33.164973 24003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:33.165585 24003 leader_election.cc:302] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88d46001e501490294203af47316a2f0; no voters:
I20260619 04:42:33.166326 24003 leader_election.cc:288] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:42:33.166472 24008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:33.167835 24008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 LEADER]: Becoming Leader. State: Replica: 88d46001e501490294203af47316a2f0, State: Running, Role: LEADER
I20260619 04:42:33.168447 24008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:33.168886 24003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:33.171396 24010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88d46001e501490294203af47316a2f0. Latest consensus state: current_term: 1 leader_uuid: "88d46001e501490294203af47316a2f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } } }
I20260619 04:42:33.171849 24010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:33.172451 24009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88d46001e501490294203af47316a2f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } } }
I20260619 04:42:33.172796 24009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:33.173130 24016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:33.184015 24016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:33.194726 24016 catalog_manager.cc:1347] Generated new cluster ID: 9ea5706d95504501960017e318d4d5f2
I20260619 04:42:33.194901 24016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:33.212792 24016 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:42:33.214813 24016 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:33.222363 24016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Generated new TSK 0
I20260619 04:42:33.223539 24016 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:42:33.289765 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38573
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:33.666049 24030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:33.666447 24030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:33.666671 24030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:33.674144 24030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:33.674352 24030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:33.674551 24030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:42:33.684973 24030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:33.686427 24030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:33.687847 24030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:33.701419 24035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:33.701444 24036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:33.701604 24038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:33.702373 24030 server_base.cc:1034] running on GCE node
I20260619 04:42:33.703054 24030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:33.704089 24030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:33.705372 24030 hybrid_clock.cc:648] HybridClock initialized: now 1781844153705328 us; error 36 us; skew 500 ppm
I20260619 04:42:33.705754 24030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:33 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844153, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:33.709385 24030 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:42:33.711006 24030 webserver.cc:460] Webserver started at http://127.9.224.65:35805/ using document root <none> and password file <none>
I20260619 04:42:33.711772 24030 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:33.711913 24030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:33.712250 24030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:33.715432 24030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "88a1936fac484c718d66647a695ba73a"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "92dc335b58a749b1e61143dcec5579f6"
server_key_iv: "7ff4c8da92965cf9cfda97c6e1dbf391"
server_key_version: "encryptionkey@0"
I20260619 04:42:33.716256 24030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "88a1936fac484c718d66647a695ba73a"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "92dc335b58a749b1e61143dcec5579f6"
server_key_iv: "7ff4c8da92965cf9cfda97c6e1dbf391"
server_key_version: "encryptionkey@0"
I20260619 04:42:33.721767 24030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:42:33.725517 24045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:33.726980 24030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:42:33.727164 24030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "88a1936fac484c718d66647a695ba73a"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "92dc335b58a749b1e61143dcec5579f6"
server_key_iv: "7ff4c8da92965cf9cfda97c6e1dbf391"
server_key_version: "encryptionkey@0"
I20260619 04:42:33.727356 24030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:33.761529 24030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:33.766323 24030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:33.766618 24030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:33.767580 24030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:33.769022 24030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:33.769090 24030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:33.769282 24030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:33.769345 24030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:33.802860 24030 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:36229
I20260619 04:42:33.802949 24157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:36229 every 8 connection(s)
I20260619 04:42:33.804196 24030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:42:33.805323 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24030
I20260619 04:42:33.805586 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:42:33.806478 10113 external_mini_cluster.cc:1428] Setting key b8f61971728d639bcc3b69f6c67f53dc
Jun 19 04:42:33 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844153, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:33.828061 24160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:33.807327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:39517 (local address 127.9.224.126:38573)
0619 04:42:33.807807 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:33.807813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:33.808936 (+ 1123us) server_negotiation.cc:407] Connection header received
0619 04:42:33.811104 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:33.811113 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:33.811211 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:33.811340 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:33.812907 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:33.814088 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:33.816086 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:33.816514 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:33.816661 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:33.820901 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:33.820908 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:33.820911 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:33.820945 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:33.823753 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:33.824829 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:33.824833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:33.824836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:33.824961 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:33.825573 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:33.825577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:33.825579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:33.825858 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:33.825970 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:33.827170 (+ 1200us) server_negotiation.cc:299] Negotiation successful
0619 04:42:33.827548 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":254,"threads_started":1}
I20260619 04:42:33.829403 24161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:33.807845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:39517)
0619 04:42:33.808687 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:33.808734 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:33.810777 (+ 2043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:33.811560 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:33.811569 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:33.812134 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:33.812711 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:33.812729 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:33.814314 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:33.814318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:33.815866 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:33.815879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:33.816765 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:33.816771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:33.817040 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:33.817806 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:33.817832 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:33.820622 (+ 2790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:33.823921 (+ 3299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:33.823934 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:33.823956 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:33.824682 (+ 726us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:33.825083 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:33.825091 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:33.825098 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:33.825440 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:33.825995 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:33.826008 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:33.826612 (+ 604us) client_negotiation.cc:769] Sending connection context
0619 04:42:33.826973 (+ 361us) client_negotiation.cc:240] Negotiation successful
0619 04:42:33.827647 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":388,"threads_started":1}
I20260619 04:42:33.831445 24158 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38573
I20260619 04:42:33.831801 24158 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:42:33.832692 24158 heartbeater.cc:511] Master 127.9.224.126:38573 requested a full tablet report, sending...
I20260619 04:42:33.835057 23968 ts_manager.cc:194] Registered new tserver with Master: 88a1936fac484c718d66647a695ba73a (127.9.224.65:36229)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:42:33.836961 23968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:39517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:42:33.863492 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38573
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:34.202482 24164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:34.202790 24164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:34.202958 24164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:34.210315 24164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:34.210438 24164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:34.210644 24164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:42:34.220656 24164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:34.222193 24164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:34.223647 24164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:34.237887 24170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:34.238005 24172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:34.237983 24169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:34.239306 24164 server_base.cc:1034] running on GCE node
I20260619 04:42:34.240001 24164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:34.241026 24164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:34.242306 24164 hybrid_clock.cc:648] HybridClock initialized: now 1781844154242180 us; error 64 us; skew 500 ppm
I20260619 04:42:34.242653 24164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:34 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844154, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:34.246191 24164 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:42:34.247794 24164 webserver.cc:460] Webserver started at http://127.9.224.66:40585/ using document root <none> and password file <none>
I20260619 04:42:34.248572 24164 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:34.248711 24164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:34.249068 24164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:34.252220 24164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "3ab032ffc2b345e5b01bc7245da58619"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "fa2e23469522393e8f34a757bb55ddb4"
server_key_iv: "dc640eca9ef0c6153acd7627decdaaab"
server_key_version: "encryptionkey@0"
I20260619 04:42:34.253130 24164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "3ab032ffc2b345e5b01bc7245da58619"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "fa2e23469522393e8f34a757bb55ddb4"
server_key_iv: "dc640eca9ef0c6153acd7627decdaaab"
server_key_version: "encryptionkey@0"
I20260619 04:42:34.258946 24164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:42:34.262773 24179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:34.264267 24164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:42:34.264472 24164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "3ab032ffc2b345e5b01bc7245da58619"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "fa2e23469522393e8f34a757bb55ddb4"
server_key_iv: "dc640eca9ef0c6153acd7627decdaaab"
server_key_version: "encryptionkey@0"
I20260619 04:42:34.264698 24164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:34.289739 24164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:34.294196 24164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:34.294581 24164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:34.295600 24164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:34.297185 24164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:34.297291 24164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:34.297438 24164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:34.297513 24164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:34.331924 24164 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:40387
I20260619 04:42:34.332036 24291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:40387 every 8 connection(s)
I20260619 04:42:34.333343 24164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:42:34.337808 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24164
I20260619 04:42:34.338030 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:42:34.338661 10113 external_mini_cluster.cc:1428] Setting key d004096cbf081314a51e8d7d917ff79e
Jun 19 04:42:34 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844154, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:34.358714 24294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.336014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:32957 (local address 127.9.224.126:38573)
0619 04:42:34.336490 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:34.336497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:34.337509 (+ 1012us) server_negotiation.cc:407] Connection header received
0619 04:42:34.340044 (+ 2535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:34.340048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:34.340117 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:34.340211 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:34.342352 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.343103 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.345763 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.346215 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.346430 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.351548 (+ 5118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:34.351555 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:34.351559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:34.351598 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:34.354628 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:34.355756 (+ 1128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:34.355767 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:34.355771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:34.355938 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:34.356551 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:34.356556 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:34.356558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:34.356907 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:34.357050 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:34.358110 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0619 04:42:34.358406 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":341,"thread_start_us":213,"threads_started":1}
I20260619 04:42:34.360323 24295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.336573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:32957)
0619 04:42:34.337295 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:34.337335 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:34.339704 (+ 2369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:34.340520 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:34.340532 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:34.341176 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:34.342095 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.342128 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.343271 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.343280 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.345562 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.345584 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.346548 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.346559 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.346921 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.347793 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:34.347830 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:34.351210 (+ 3380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:34.354811 (+ 3601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:34.354825 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:34.354849 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:34.355581 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:34.356105 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:34.356113 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:34.356119 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:34.356416 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:34.357087 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:34.357098 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:34.357641 (+ 543us) client_negotiation.cc:769] Sending connection context
0619 04:42:34.358008 (+ 367us) client_negotiation.cc:240] Negotiation successful
0619 04:42:34.358675 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":272,"threads_started":1}
I20260619 04:42:34.362100 24292 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38573
I20260619 04:42:34.362496 24292 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:34.363305 24292 heartbeater.cc:511] Master 127.9.224.126:38573 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
I20260619 04:42:34.365000 23968 ts_manager.cc:194] Registered new tserver with Master: 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66:40387)
I20260619 04:42:34.366029 23968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:32957
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:42:34.397480 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38573
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:34.748885 24298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:34.749199 24298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:34.749300 24298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:34.756829 24298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:34.756966 24298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:34.757110 24298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:42:34.767706 24298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:34.769096 24298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:34.770664 24298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:34.785058 24303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:34.785539 24306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:34.785681 24304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:34.786064 24298 server_base.cc:1034] running on GCE node
I20260619 04:42:34.786723 24298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:34.787706 24298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:34.788937 24298 hybrid_clock.cc:648] HybridClock initialized: now 1781844154788887 us; error 45 us; skew 500 ppm
I20260619 04:42:34.789276 24298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:34 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844154, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:34.792855 24298 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:42:34.794409 24298 webserver.cc:460] Webserver started at http://127.9.224.67:44483/ using document root <none> and password file <none>
I20260619 04:42:34.795114 24298 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:34.795231 24298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:34.795526 24298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:34.799108 24298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "b65217d69f344bfb97e0984b1e442fca"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "11162b138c984edd41974fa66f01805c"
server_key_iv: "b188e60b9d1154e5289626ee44b00036"
server_key_version: "encryptionkey@0"
I20260619 04:42:34.799995 24298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "b65217d69f344bfb97e0984b1e442fca"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "11162b138c984edd41974fa66f01805c"
server_key_iv: "b188e60b9d1154e5289626ee44b00036"
server_key_version: "encryptionkey@0"
I20260619 04:42:34.805825 24298 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:42:34.809715 24313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:34.811370 24298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:42:34.811599 24298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "b65217d69f344bfb97e0984b1e442fca"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "11162b138c984edd41974fa66f01805c"
server_key_iv: "b188e60b9d1154e5289626ee44b00036"
server_key_version: "encryptionkey@0"
I20260619 04:42:34.811825 24298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:34.831151 24298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:34.835635 24298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:34.835896 24298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:34.836833 24298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:34.838215 24298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:34.838357 24298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:34.838471 24298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:34.838847 24298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:34.840929 24158 heartbeater.cc:503] Master 127.9.224.126:38573 was elected leader, sending a full tablet report...
I20260619 04:42:34.876886 24298 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:42347
I20260619 04:42:34.876920 24425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:42347 every 8 connection(s)
I20260619 04:42:34.878492 24298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:42:34.883766 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24298
I20260619 04:42:34.883966 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:42:34.884542 10113 external_mini_cluster.cc:1428] Setting key 3b3c0139a6b264f76bbd658c452baa76
Jun 19 04:42:34 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844154, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:34.900816 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.881297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:42443 (local address 127.9.224.126:38573)
0619 04:42:34.881805 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:34.881812 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:34.882897 (+ 1085us) server_negotiation.cc:407] Connection header received
0619 04:42:34.885411 (+ 2514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:34.885417 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:34.885523 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:34.885646 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:34.887443 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.888370 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.889919 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.890375 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.890514 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.894293 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:34.894304 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:34.894317 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:34.894360 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:34.897202 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:34.898090 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:34.898094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:34.898097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:34.898216 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:34.898795 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:34.898800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:34.898804 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:34.899129 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:34.899294 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:34.900150 (+ 856us) server_negotiation.cc:299] Negotiation successful
0619 04:42:34.900395 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":232,"threads_started":1}
I20260619 04:42:34.901857 24429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.881921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:42443)
0619 04:42:34.882726 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:34.882771 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:34.885124 (+ 2353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:34.885908 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:34.885918 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:34.886672 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:34.887265 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.887284 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.888533 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.888539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.889761 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.889774 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.890635 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.890644 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.890898 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.891637 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:34.891666 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:34.893968 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:34.897400 (+ 3432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:34.897413 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:34.897433 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:34.897975 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:34.898393 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:34.898398 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:34.898401 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:34.898667 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:34.899274 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:34.899282 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:34.899753 (+ 471us) client_negotiation.cc:769] Sending connection context
0619 04:42:34.900046 (+ 293us) client_negotiation.cc:240] Negotiation successful
0619 04:42:34.900654 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":378,"threads_started":1}
I20260619 04:42:34.903456 24426 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38573
I20260619 04:42:34.903734 24426 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:34.904446 24426 heartbeater.cc:511] Master 127.9.224.126:38573 requested a full tablet report, sending...
I20260619 04:42:34.906003 23968 ts_manager.cc:194] Registered new tserver with Master: b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347)
I20260619 04:42:34.906965 23968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:42443
I20260619 04:42:34.912817 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:42:34.932438 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.917682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60384 (local address 127.9.224.126:38573)
0619 04:42:34.917929 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:34.917937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:34.918288 (+ 351us) server_negotiation.cc:407] Connection header received
0619 04:42:34.918495 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:34.918499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:34.918590 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:34.918674 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:34.920055 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.920767 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.922338 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.922769 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.922892 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.925775 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:34.925781 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:34.925785 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:34.925823 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:34.928607 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:34.929622 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:34.929627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:34.929629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:34.929752 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:34.930109 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:34.930113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:34.930115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:34.930610 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:34.930792 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:34.931275 (+ 483us) server_negotiation.cc:299] Negotiation successful
0619 04:42:34.931598 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:42:34.937760 23968 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:42:34.946151 23968 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:42:34.973726 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.960989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34046 (local address 127.9.224.67:42347)
0619 04:42:34.961893 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:34.961904 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:34.965386 (+ 3482us) server_negotiation.cc:407] Connection header received
0619 04:42:34.965710 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:34.965722 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:34.965982 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:34.966161 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:34.967178 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.968915 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.971631 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.972630 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.972778 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.973028 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:34.973196 (+ 168us) server_negotiation.cc:299] Negotiation successful
0619 04:42:34.973379 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":493,"threads_started":1}
I20260619 04:42:34.973768 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.960418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:42347 (local address 127.0.0.1:34046)
0619 04:42:34.965228 (+ 4810us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:34.965248 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:34.965507 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:34.966529 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:34.966537 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:34.966566 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:34.966958 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.966969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.969055 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.969061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.971475 (+ 2414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.971488 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.972800 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.972804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.972943 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.972978 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 04:42:34.973120 (+ 142us) client_negotiation.cc:240] Negotiation successful
0619 04:42:34.973315 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4684,"mutex_wait_us":277,"thread_start_us":4551,"threads_started":1}
I20260619 04:42:34.975628 24442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.961013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40387 (local address 127.0.0.1:34656)
0619 04:42:34.966184 (+ 5171us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:34.966202 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:34.966510 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:34.967236 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:34.967240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:34.967267 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:34.967585 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.967594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.969211 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.969217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.972506 (+ 3289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.972521 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.974788 (+ 2267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.974795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.974961 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.974996 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 04:42:34.975111 (+ 115us) client_negotiation.cc:240] Negotiation successful
0619 04:42:34.975248 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5055,"mutex_wait_us":640,"thread_start_us":4868,"threads_started":1}
I20260619 04:42:34.975673 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.961547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34656 (local address 127.9.224.66:40387)
0619 04:42:34.965623 (+ 4076us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:34.965635 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:34.966394 (+ 759us) server_negotiation.cc:407] Connection header received
0619 04:42:34.966706 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:34.966714 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:34.966947 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:34.967129 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:34.967746 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.969046 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.972691 (+ 3645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.974577 (+ 1886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.974725 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.974917 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:34.975173 (+ 256us) server_negotiation.cc:299] Negotiation successful
0619 04:42:34.975353 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3897,"thread_start_us":3780,"threads_started":1}
I20260619 04:42:34.976958 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.959777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52436)
0619 04:42:34.960769 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:34.960831 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:34.961066 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:34.965794 (+ 4728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:34.965802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:34.965852 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:34.966454 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.966474 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.968946 (+ 2472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.968952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.972509 (+ 3557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:34.972521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.976143 (+ 3622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.976149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:34.976322 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.976353 (+ 31us) client_negotiation.cc:769] Sending connection context
0619 04:42:34.976459 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 04:42:34.976592 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":848,"thread_start_us":379,"threads_started":1}
I20260619 04:42:34.976987 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:34.960030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52436 (local address 127.9.224.65:36229)
0619 04:42:34.964932 (+ 4902us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:34.964949 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:34.964986 (+ 37us) server_negotiation.cc:407] Connection header received
0619 04:42:34.965107 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:34.965117 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:34.965529 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:34.966670 (+ 1141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:34.966949 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.968810 (+ 1861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.974347 (+ 5537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:34.975806 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:34.975995 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:34.976231 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:34.976506 (+ 275us) server_negotiation.cc:299] Negotiation successful
0619 04:42:34.976681 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4686,"thread_start_us":4499,"threads_started":1}
I20260619 04:42:34.978188 24361 tablet_service.cc:1467] Processing CreateTablet for tablet b81aa14cc21d457fbafae112399bd64d (DEFAULT_TABLE table=test-table [id=6e3efe6746ad49d2b721f3a283747ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:34.979797 24361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b81aa14cc21d457fbafae112399bd64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:34.980657 24093 tablet_service.cc:1467] Processing CreateTablet for tablet b81aa14cc21d457fbafae112399bd64d (DEFAULT_TABLE table=test-table [id=6e3efe6746ad49d2b721f3a283747ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:34.981830 24093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b81aa14cc21d457fbafae112399bd64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:34.986570 24227 tablet_service.cc:1467] Processing CreateTablet for tablet b81aa14cc21d457fbafae112399bd64d (DEFAULT_TABLE table=test-table [id=6e3efe6746ad49d2b721f3a283747ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:34.988058 24227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b81aa14cc21d457fbafae112399bd64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:34.993158 24445 tablet_bootstrap.cc:492] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Bootstrap starting.
I20260619 04:42:34.996482 24445 tablet_bootstrap.cc:654] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:34.998343 24445 log.cc:824] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:34.999579 24446 tablet_bootstrap.cc:492] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Bootstrap starting.
I20260619 04:42:35.001173 24445 tablet_bootstrap.cc:492] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: No bootstrap required, opened a new log
I20260619 04:42:35.001462 24445 ts_tablet_manager.cc:1397] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 04:42:35.003374 24446 tablet_bootstrap.cc:654] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:35.004706 24446 log.cc:824] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:35.004760 24448 tablet_bootstrap.cc:492] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Bootstrap starting.
I20260619 04:42:35.008394 24446 tablet_bootstrap.cc:492] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: No bootstrap required, opened a new log
I20260619 04:42:35.008680 24446 ts_tablet_manager.cc:1397] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 04:42:35.009407 24448 tablet_bootstrap.cc:654] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:35.010730 24448 log.cc:824] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:35.011756 24445 raft_consensus.cc:348] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.012148 24445 raft_consensus.cc:374] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:35.012251 24445 raft_consensus.cc:729] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a1936fac484c718d66647a695ba73a, State: Initialized, Role: FOLLOWER
I20260619 04:42:35.012897 24445 consensus_queue.cc:260] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.014086 24448 tablet_bootstrap.cc:492] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: No bootstrap required, opened a new log
I20260619 04:42:35.014438 24448 ts_tablet_manager.cc:1397] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 04:42:35.014771 24445 ts_tablet_manager.cc:1428] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260619 04:42:35.019014 24446 raft_consensus.cc:348] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.019476 24446 raft_consensus.cc:374] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:35.019579 24446 raft_consensus.cc:729] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65217d69f344bfb97e0984b1e442fca, State: Initialized, Role: FOLLOWER
I20260619 04:42:35.020210 24446 consensus_queue.cc:260] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.021283 24426 heartbeater.cc:503] Master 127.9.224.126:38573 was elected leader, sending a full tablet report...
I20260619 04:42:35.022008 24446 ts_tablet_manager.cc:1428] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260619 04:42:35.024410 24448 raft_consensus.cc:348] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.024839 24448 raft_consensus.cc:374] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:35.024955 24448 raft_consensus.cc:729] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab032ffc2b345e5b01bc7245da58619, State: Initialized, Role: FOLLOWER
I20260619 04:42:35.025611 24448 consensus_queue.cc:260] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.026705 24292 heartbeater.cc:503] Master 127.9.224.126:38573 was elected leader, sending a full tablet report...
I20260619 04:42:35.027396 24448 ts_tablet_manager.cc:1428] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260619 04:42:35.056797 24159 tablet.cc:2369] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:42:35.085469 24293 tablet.cc:2369] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:42:35.130436 24427 tablet.cc:2369] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:42:35.304980 24451 raft_consensus.cc:482] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:42:35.305294 24451 raft_consensus.cc:504] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.307062 24451 leader_election.cc:288] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66:40387), b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347)
I20260619 04:42:35.313691 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.307514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:37955 (local address 127.9.224.67:42347)
0619 04:42:35.307763 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:35.307773 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:35.308177 (+ 404us) server_negotiation.cc:407] Connection header received
0619 04:42:35.308427 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:35.308434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:35.308502 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:35.308609 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:35.309265 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.309994 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.311859 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.312660 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.312863 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.312942 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:35.313274 (+ 332us) server_negotiation.cc:299] Negotiation successful
0619 04:42:35.313407 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260619 04:42:35.313766 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.307360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:42347 (local address 127.9.224.65:37955)
0619 04:42:35.308044 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:35.308061 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:35.308270 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:35.308626 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:35.308631 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:35.308654 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:35.309121 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:35.309134 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.310122 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.310130 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:35.311703 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:35.311716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.312880 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.312886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:35.313105 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.313132 (+ 27us) client_negotiation.cc:769] Sending connection context
0619 04:42:35.313248 (+ 116us) client_negotiation.cc:240] Negotiation successful
0619 04:42:35.313395 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":461,"threads_started":1}
I20260619 04:42:35.313855 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.307539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:46663 (local address 127.9.224.66:40387)
0619 04:42:35.307772 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:35.307778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:35.308664 (+ 886us) server_negotiation.cc:407] Connection header received
0619 04:42:35.308900 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:35.308904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:35.308964 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:35.309064 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:35.309580 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.310328 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.312050 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.312830 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.313021 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.313115 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:35.313431 (+ 316us) server_negotiation.cc:299] Negotiation successful
0619 04:42:35.313576 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:42:35.314024 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.307357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40387 (local address 127.9.224.65:46663)
0619 04:42:35.308549 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:35.308563 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:35.308734 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:35.309082 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:35.309086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:35.309114 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:35.309435 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:35.309444 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.310458 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.310467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:35.311888 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:35.311899 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.313086 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.313093 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:35.313257 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.313280 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 04:42:35.313406 (+ 126us) client_negotiation.cc:240] Negotiation successful
0619 04:42:35.313537 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"mutex_wait_us":485,"thread_start_us":347,"threads_started":1}
I20260619 04:42:35.315207 24381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81aa14cc21d457fbafae112399bd64d" candidate_uuid: "88a1936fac484c718d66647a695ba73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65217d69f344bfb97e0984b1e442fca" is_pre_election: true
I20260619 04:42:35.315218 24247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81aa14cc21d457fbafae112399bd64d" candidate_uuid: "88a1936fac484c718d66647a695ba73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab032ffc2b345e5b01bc7245da58619" is_pre_election: true
I20260619 04:42:35.315845 24381 raft_consensus.cc:2454] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88a1936fac484c718d66647a695ba73a in term 0.
I20260619 04:42:35.315852 24247 raft_consensus.cc:2454] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88a1936fac484c718d66647a695ba73a in term 0.
I20260619 04:42:35.316617 24048 leader_election.cc:302] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ab032ffc2b345e5b01bc7245da58619, 88a1936fac484c718d66647a695ba73a; no voters:
I20260619 04:42:35.317085 24451 raft_consensus.cc:2781] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:42:35.317242 24451 raft_consensus.cc:482] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:42:35.317358 24451 raft_consensus.cc:3037] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:35.319768 24451 raft_consensus.cc:504] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.320501 24451 leader_election.cc:288] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [CANDIDATE]: Term 1 election: Requested vote from peers 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66:40387), b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347)
I20260619 04:42:35.321066 24247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81aa14cc21d457fbafae112399bd64d" candidate_uuid: "88a1936fac484c718d66647a695ba73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab032ffc2b345e5b01bc7245da58619"
I20260619 04:42:35.321161 24381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81aa14cc21d457fbafae112399bd64d" candidate_uuid: "88a1936fac484c718d66647a695ba73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65217d69f344bfb97e0984b1e442fca"
I20260619 04:42:35.321283 24247 raft_consensus.cc:3037] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:35.321451 24381 raft_consensus.cc:3037] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:35.323770 24247 raft_consensus.cc:2454] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a1936fac484c718d66647a695ba73a in term 1.
I20260619 04:42:35.323825 24381 raft_consensus.cc:2454] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a1936fac484c718d66647a695ba73a in term 1.
I20260619 04:42:35.324363 24046 leader_election.cc:302] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a1936fac484c718d66647a695ba73a, b65217d69f344bfb97e0984b1e442fca; no voters:
I20260619 04:42:35.324723 24451 raft_consensus.cc:2781] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:35.325234 24451 raft_consensus.cc:686] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 1 LEADER]: Becoming Leader. State: Replica: 88a1936fac484c718d66647a695ba73a, State: Running, Role: LEADER
I20260619 04:42:35.325748 24451 consensus_queue.cc:237] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } }
I20260619 04:42:35.331164 23967 catalog_manager.cc:5495] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a reported cstate change: term changed from 0 to 1, leader changed from <none> to 88a1936fac484c718d66647a695ba73a (127.9.224.65). New cstate: current_term: 1 leader_uuid: "88a1936fac484c718d66647a695ba73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } health_report { overall_health: UNKNOWN } } }
I20260619 04:42:35.437136 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.430906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52446 (local address 127.9.224.65:36229)
0619 04:42:35.431109 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:35.431113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:35.431132 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:42:35.431342 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:35.431345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:35.431438 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:35.431626 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:42:35.432219 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.433032 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.434701 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.435131 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.435240 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.435872 (+ 632us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:42:35.436431 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:42:35.436548 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:35.436704 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 04:42:35.436782 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:42:35.446094 24247 raft_consensus.cc:1261] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Refusing update from remote peer 88a1936fac484c718d66647a695ba73a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:35.446105 24381 raft_consensus.cc:1261] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Refusing update from remote peer 88a1936fac484c718d66647a695ba73a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:35.447304 24456 consensus_queue.cc:1035] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:35.447788 24451 consensus_queue.cc:1035] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:35.461650 24461 mvcc.cc:205] Tried to move back new op lower bound from 7298433660696502272 to 7298433660218445824. Current Snapshot: MvccSnapshot[applied={T|T < 7298433660696502272}]
I20260619 04:42:35.477361 23968 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:42:35.477690 23968 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:42:35.481827 23968 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Sending DeleteTablet for 3 replicas of tablet b81aa14cc21d457fbafae112399bd64d
I20260619 04:42:35.483183 24093 tablet_service.cc:1514] Processing DeleteTablet for tablet b81aa14cc21d457fbafae112399bd64d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:35 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:52436
I20260619 04:42:35.483314 24227 tablet_service.cc:1514] Processing DeleteTablet for tablet b81aa14cc21d457fbafae112399bd64d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:35 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:34656
I20260619 04:42:35.483337 24361 tablet_service.cc:1514] Processing DeleteTablet for tablet b81aa14cc21d457fbafae112399bd64d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:35 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:34046
I20260619 04:42:35.484815 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24030
I20260619 04:42:35.523303 24470 tablet_replica.cc:330] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: stopping tablet replica
I20260619 04:42:35.523844 24470 raft_consensus.cc:2229] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:42:35.523949 24471 tablet_replica.cc:330] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: stopping tablet replica
I20260619 04:42:35.524432 24471 raft_consensus.cc:2229] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:42:35.524643 24470 raft_consensus.cc:2258] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:35.524941 24471 raft_consensus.cc:2258] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:35.522127 24469 tablet_replica.cc:330] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: stopping tablet replica
I20260619 04:42:35.525715 24469 raft_consensus.cc:2229] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:42:35.526304 24469 raft_consensus.cc:2258] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:35.526840 24470 ts_tablet_manager.cc:1905] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:35.528090 24471 ts_tablet_manager.cc:1905] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 04:42:35 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:42:35.531991 24469 ts_tablet_manager.cc:1905] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:35.535462 24470 ts_tablet_manager.cc:1918] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:35.535673 24470 log.cc:1196] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/b81aa14cc21d457fbafae112399bd64d
I20260619 04:42:35.536257 24470 ts_tablet_manager.cc:1939] T b81aa14cc21d457fbafae112399bd64d P 88a1936fac484c718d66647a695ba73a: Deleting consensus metadata
I20260619 04:42:35.538264 23954 catalog_manager.cc:4841] TS 88a1936fac484c718d66647a695ba73a (127.9.224.65:36229): tablet b81aa14cc21d457fbafae112399bd64d (table test-table [id=6e3efe6746ad49d2b721f3a283747ff8]) successfully deleted
I20260619 04:42:35.539587 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.486486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52454 (local address 127.9.224.65:36229)
0619 04:42:35.489314 (+ 2828us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:35.489682 (+ 368us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:35.511668 (+ 21986us) server_negotiation.cc:407] Connection header received
0619 04:42:35.512365 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:35.512372 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:35.512494 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:35.512594 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:35.516643 (+ 4049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.518348 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.522784 (+ 4436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.523458 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.523637 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.530094 (+ 6457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:35.530112 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:35.530132 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:35.530197 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:35.535010 (+ 4813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:35.536446 (+ 1436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:35.536461 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:35.536465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:35.536695 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:35.537245 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:35.537251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:35.537254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:35.537718 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:35.538027 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:35.538825 (+ 798us) server_negotiation.cc:299] Negotiation successful
0619 04:42:35.539090 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2394}
I20260619 04:42:35.540166 24469 ts_tablet_manager.cc:1918] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:35.540349 24469 log.cc:1196] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b81aa14cc21d457fbafae112399bd64d
I20260619 04:42:35.541167 24469 ts_tablet_manager.cc:1939] T b81aa14cc21d457fbafae112399bd64d P 3ab032ffc2b345e5b01bc7245da58619: Deleting consensus metadata
I20260619 04:42:35.541692 24153 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:35.543473 23954 catalog_manager.cc:4841] TS 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66:40387): tablet b81aa14cc21d457fbafae112399bd64d (table test-table [id=6e3efe6746ad49d2b721f3a283747ff8]) successfully deleted
I20260619 04:42:35.545331 24471 ts_tablet_manager.cc:1918] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:35.545568 24471 log.cc:1196] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b81aa14cc21d457fbafae112399bd64d
I20260619 04:42:35.546142 24471 ts_tablet_manager.cc:1939] T b81aa14cc21d457fbafae112399bd64d P b65217d69f344bfb97e0984b1e442fca: Deleting consensus metadata
I20260619 04:42:35.548002 23952 catalog_manager.cc:4841] TS b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347): tablet b81aa14cc21d457fbafae112399bd64d (table test-table [id=6e3efe6746ad49d2b721f3a283747ff8]) successfully deleted
I20260619 04:42:35.644588 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24030
I20260619 04:42:35.660749 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24164
Jun 19 04:42:35 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:42:35.677695 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.661661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34662 (local address 127.9.224.66:40387)
0619 04:42:35.661859 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:35.661864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:35.661884 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:42:35.661978 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:35.661982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:35.662045 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:35.662135 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:35.663475 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.664221 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.665647 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.666174 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.666383 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.671031 (+ 4648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:35.671051 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:35.671068 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:35.671110 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:35.674549 (+ 3439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:35.675330 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:35.675338 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:35.675341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:35.675504 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:35.676018 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:35.676021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:35.676023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:35.676463 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:35.676709 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:35.677096 (+ 387us) server_negotiation.cc:299] Negotiation successful
0619 04:42:35.677275 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:42:35.678474 24287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:35.769910 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24164
I20260619 04:42:35.787388 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24298
Jun 19 04:42:35 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:42:35.804049 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:35.788200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34062 (local address 127.9.224.67:42347)
0619 04:42:35.788390 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:35.788397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:35.788442 (+ 45us) server_negotiation.cc:407] Connection header received
0619 04:42:35.788701 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:35.788705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:35.788806 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:35.788934 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:35.790291 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.791022 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.792336 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:35.792751 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:35.792888 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:35.797565 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:35.797583 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:35.797601 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:35.797638 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:35.800904 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:35.801758 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:35.801765 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:35.801768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:35.801949 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:35.802527 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:35.802536 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:35.802542 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:35.803000 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:35.803251 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:35.803602 (+ 351us) server_negotiation.cc:299] Negotiation successful
0619 04:42:35.803779 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:42:35.804847 24421 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:35.896797 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24298
I20260619 04:42:35.913825 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 23936
I20260619 04:42:35.915092 23998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:36.028831 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 23936
I20260619 04:42:36.050783 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38573
--webserver_interface=127.9.224.126
--webserver_port=40861
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:38573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:36.391939 24477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:36.392318 24477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:36.392491 24477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:36.400053 24477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:36.400220 24477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:36.400339 24477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:36.400447 24477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:36.400534 24477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:36.411091 24477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:38573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=40861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:36.412489 24477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:36.413928 24477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:36.438508 24483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:36.438509 24486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:36.438535 24484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:36.439430 24477 server_base.cc:1034] running on GCE node
I20260619 04:42:36.440377 24477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:36.442052 24477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:36.443265 24477 hybrid_clock.cc:648] HybridClock initialized: now 1781844156443193 us; error 72 us; skew 500 ppm
I20260619 04:42:36.443655 24477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:36 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844156, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:36.447360 24477 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:36.449141 24477 webserver.cc:460] Webserver started at http://127.9.224.126:40861/ using document root <none> and password file <none>
I20260619 04:42:36.449899 24477 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:36.450022 24477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:36.456439 24477 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260619 04:42:36.459689 24493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:36.461154 24477 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 04:42:36.461311 24477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "88d46001e501490294203af47316a2f0"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "eb9585d37df40efa5cd923581f18450b"
server_key_iv: "0fb6c69d3c312f48f77d2e140e841bf7"
server_key_version: "encryptionkey@0"
I20260619 04:42:36.462440 24477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:36.475379 24477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:36.479951 24477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:36.480211 24477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:36.501474 24477 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:38573
I20260619 04:42:36.501596 24544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:38573 every 8 connection(s)
I20260619 04:42:36.503141 24477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:36.504185 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24477
I20260619 04:42:36.505412 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:36229
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:38573
--webserver_port=35805
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:42:36.515112 24545 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:42:36.519375 24545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap starting.
I20260619 04:42:36.542511 24545 log.cc:824] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:36.556339 24545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:42:36.556970 24545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap complete.
I20260619 04:42:36.567914 24545 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:36.568917 24545 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88d46001e501490294203af47316a2f0, State: Initialized, Role: FOLLOWER
I20260619 04:42:36.569645 24545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:36.569916 24545 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:36.570067 24545 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:36.570298 24545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 1 FOLLOWER]: Advancing to term 2
I20260619 04:42:36.574735 24545 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:36.575409 24545 leader_election.cc:302] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88d46001e501490294203af47316a2f0; no voters:
I20260619 04:42:36.576164 24545 leader_election.cc:288] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 04:42:36.576314 24549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 04:42:36.577720 24549 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 LEADER]: Becoming Leader. State: Replica: 88d46001e501490294203af47316a2f0, State: Running, Role: LEADER
I20260619 04:42:36.578379 24549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:36.578847 24545 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:36.581231 24551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88d46001e501490294203af47316a2f0. Latest consensus state: current_term: 2 leader_uuid: "88d46001e501490294203af47316a2f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } } }
I20260619 04:42:36.581641 24551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:36.581311 24550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "88d46001e501490294203af47316a2f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } } }
I20260619 04:42:36.581764 24550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:36.587569 24555 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:36.598910 24555 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:36.601114 24555 catalog_manager.cc:1259] Loaded cluster ID: 9ea5706d95504501960017e318d4d5f2
I20260619 04:42:36.601270 24555 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:36.606334 24555 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260619 04:42:36.619683 24566 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 04:42:36.626905 24555 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260619 04:42:36.635241 24555 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:36.636879 24555 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Loaded TSK: 0
I20260619 04:42:36.638278 24555 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 04:42:36.901170 24547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:36.901553 24547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:36.901739 24547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:36.909516 24547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:36.909685 24547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:36.909860 24547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:42:36.920162 24547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:36229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=35805
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:36.921546 24547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:36.923041 24547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:36.938699 24572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:36.938719 24573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:36.939172 24575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:36.940079 24547 server_base.cc:1034] running on GCE node
I20260619 04:42:36.940737 24547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:36.941798 24547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:36.943058 24547 hybrid_clock.cc:648] HybridClock initialized: now 1781844156942998 us; error 53 us; skew 500 ppm
I20260619 04:42:36.943420 24547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:36 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844156, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:36.946918 24547 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:42:36.948618 24547 webserver.cc:460] Webserver started at http://127.9.224.65:35805/ using document root <none> and password file <none>
I20260619 04:42:36.949348 24547 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:36.949493 24547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:36.955705 24547 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:42:36.959022 24582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:36.960662 24547 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:42:36.960845 24547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "88a1936fac484c718d66647a695ba73a"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "92dc335b58a749b1e61143dcec5579f6"
server_key_iv: "7ff4c8da92965cf9cfda97c6e1dbf391"
server_key_version: "encryptionkey@0"
I20260619 04:42:36.961895 24547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:36.980595 24547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:36.985101 24547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:36.985389 24547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:36.986594 24547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:36.988067 24547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:36.988157 24547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:36.988327 24547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:36.988430 24547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.022604 24547 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:36229
I20260619 04:42:37.022712 24694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:36229 every 8 connection(s)
I20260619 04:42:37.024165 24547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:42:37.027256 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24547
I20260619 04:42:37.028069 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:40387
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:38573
--webserver_port=40585
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:42:37 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844156, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:37.056404 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.027433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:58703)
0619 04:42:37.030890 (+ 3457us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:37.030948 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:37.032752 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:37.034505 (+ 1753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:37.034517 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:37.035330 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:37.036150 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:37.036172 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.038920 (+ 2748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.038925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:37.040278 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:37.040294 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.042058 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.042064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:37.042444 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:37.043278 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:37.043311 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:37.045921 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:37.051458 (+ 5537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:37.051468 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:37.051482 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:37.052068 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:37.052737 (+ 669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:37.052741 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:37.052744 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:37.052985 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:37.054082 (+ 1097us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:37.054089 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:37.054578 (+ 489us) client_negotiation.cc:769] Sending connection context
0619 04:42:37.054847 (+ 269us) client_negotiation.cc:240] Negotiation successful
0619 04:42:37.055282 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3147,"thread_start_us":2930,"threads_started":1}
I20260619 04:42:37.056756 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.027356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:58703 (local address 127.9.224.126:38573)
0619 04:42:37.028066 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:37.028084 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:37.031120 (+ 3036us) server_negotiation.cc:407] Connection header received
0619 04:42:37.033347 (+ 2227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:37.033368 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:37.033849 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:37.034293 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:37.036408 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.038667 (+ 2259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.040540 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.041761 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.042003 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:37.046309 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:37.046324 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:37.046352 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:37.046411 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:37.051185 (+ 4774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:37.052266 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:37.052278 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:37.052288 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:37.052574 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:37.053135 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:37.053143 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:37.053149 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:37.053913 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:37.054124 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:37.055100 (+ 976us) server_negotiation.cc:299] Negotiation successful
0619 04:42:37.055567 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":311,"threads_started":1}
I20260619 04:42:37.059729 24695 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38573
I20260619 04:42:37.060077 24695 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:37.060858 24695 heartbeater.cc:511] Master 127.9.224.126:38573 requested a full tablet report, sending...
I20260619 04:42:37.063118 24510 ts_manager.cc:194] Registered new tserver with Master: 88a1936fac484c718d66647a695ba73a (127.9.224.65:36229)
I20260619 04:42:37.064632 24510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:58703
W20260619 04:42:37.363813 24699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:37.364166 24699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:37.364341 24699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:37.372155 24699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:37.372313 24699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:37.372498 24699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:42:37.382823 24699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:40387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=40585
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:37.384230 24699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:37.385589 24699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:37.400529 24707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:37.400625 24705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:37.400885 24704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:37.401716 24699 server_base.cc:1034] running on GCE node
I20260619 04:42:37.402526 24699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:37.403606 24699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:37.404868 24699 hybrid_clock.cc:648] HybridClock initialized: now 1781844157404818 us; error 59 us; skew 500 ppm
I20260619 04:42:37.405239 24699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:37 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844157, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:37.408592 24699 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:42:37.410169 24699 webserver.cc:460] Webserver started at http://127.9.224.66:40585/ using document root <none> and password file <none>
I20260619 04:42:37.410908 24699 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:37.411079 24699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:37.416872 24699 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 04:42:37.419883 24714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.421383 24699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:42:37.421588 24699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "3ab032ffc2b345e5b01bc7245da58619"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "fa2e23469522393e8f34a757bb55ddb4"
server_key_iv: "dc640eca9ef0c6153acd7627decdaaab"
server_key_version: "encryptionkey@0"
I20260619 04:42:37.422698 24699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:37.456558 24699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:37.461337 24699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:37.461686 24699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:37.462904 24699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:37.464468 24699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:37.464609 24699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.464749 24699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:37.464843 24699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.504009 24699 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:40387
I20260619 04:42:37.504076 24826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:40387 every 8 connection(s)
I20260619 04:42:37.505616 24699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:42:37.514703 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24699
I20260619 04:42:37.515477 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:42347
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:38573
--webserver_port=44483
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:42:37 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844157, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:37.528471 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.508777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:34391 (local address 127.9.224.126:38573)
0619 04:42:37.508988 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:37.508993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:37.510220 (+ 1227us) server_negotiation.cc:407] Connection header received
0619 04:42:37.512253 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:37.512260 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:37.512393 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:37.512515 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:37.514095 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.515038 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.516953 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.517474 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.517629 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:37.521342 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:37.521352 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:37.521360 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:37.521408 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:37.524765 (+ 3357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:37.525813 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:37.525819 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:37.525822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:37.525975 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:37.526622 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:37.526625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:37.526627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:37.526964 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:37.527086 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:37.528032 (+ 946us) server_negotiation.cc:299] Negotiation successful
0619 04:42:37.528238 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:42:37.530081 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.509256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:34391)
0619 04:42:37.510051 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:37.510093 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:37.511957 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:37.512786 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:37.512795 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:37.513314 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:37.513912 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:37.513933 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.515268 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.515274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:37.516770 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:37.516783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.517720 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:37.517728 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:37.517998 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:37.518785 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:37.518809 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:37.521103 (+ 2294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:37.524949 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:37.524962 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:37.524983 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:37.525632 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:37.526087 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:37.526101 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:37.526108 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:37.526467 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:37.527088 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:37.527100 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:37.527603 (+ 503us) client_negotiation.cc:769] Sending connection context
0619 04:42:37.527920 (+ 317us) client_negotiation.cc:240] Negotiation successful
0619 04:42:37.528547 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":308,"threads_started":1}
I20260619 04:42:37.531746 24827 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38573
I20260619 04:42:37.532104 24827 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:37.533056 24827 heartbeater.cc:511] Master 127.9.224.126:38573 requested a full tablet report, sending...
I20260619 04:42:37.534698 24510 ts_manager.cc:194] Registered new tserver with Master: 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66:40387)
I20260619 04:42:37.535534 24510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:34391
W20260619 04:42:37.864331 24830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:37.864666 24830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:37.864845 24830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:37.872583 24830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:37.872716 24830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:37.872895 24830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:42:37.883566 24830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:42347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=44483
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:37.884971 24830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:37.886445 24830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:37.900319 24835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:37.900449 24838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:37.900627 24836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:37.901341 24830 server_base.cc:1034] running on GCE node
I20260619 04:42:37.901999 24830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:37.903045 24830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:37.904323 24830 hybrid_clock.cc:648] HybridClock initialized: now 1781844157904262 us; error 42 us; skew 500 ppm
I20260619 04:42:37.904650 24830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:37 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844157, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:37.914047 24830 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:42:37.916088 24830 webserver.cc:460] Webserver started at http://127.9.224.67:44483/ using document root <none> and password file <none>
I20260619 04:42:37.916872 24830 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:37.917026 24830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:37.923519 24830 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:42:37.926467 24845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.928130 24830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 04:42:37.928282 24830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "b65217d69f344bfb97e0984b1e442fca"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "11162b138c984edd41974fa66f01805c"
server_key_iv: "b188e60b9d1154e5289626ee44b00036"
server_key_version: "encryptionkey@0"
I20260619 04:42:37.929258 24830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:37.948865 24830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:37.953462 24830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:37.953708 24830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:37.954715 24830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:37.956053 24830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:37.956139 24830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.956223 24830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:37.956285 24830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:37.992573 24830 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:42347
I20260619 04:42:37.992707 24957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:42347 every 8 connection(s)
I20260619 04:42:37.994078 24830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:42:37.995275 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 24830
Jun 19 04:42:38 dist-test-slave-9dgf krb5kdc[23923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844157, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:38.010780 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.996383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.9.224.126:38573)
0619 04:42:37.996637 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:37.996646 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:37.996981 (+ 335us) server_negotiation.cc:407] Connection header received
0619 04:42:37.997205 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:37.997210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:37.997276 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:37.997384 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:37.999188 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:37.999946 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.001291 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.001788 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.001967 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.004909 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:38.004914 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:38.004917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:38.004948 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:38.008034 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.008742 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.008750 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.008753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.008895 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.009288 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.009293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.009296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.009569 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:38.009848 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.010174 (+ 326us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.010417 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":101}
I20260619 04:42:38.018785 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.997797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:46831 (local address 127.9.224.126:38573)
0619 04:42:37.998340 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:37.998347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:37.999510 (+ 1163us) server_negotiation.cc:407] Connection header received
0619 04:42:38.001418 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.001424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.001515 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.001682 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:38.003703 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.004597 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.006831 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.007542 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.007715 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.012070 (+ 4355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:38.012076 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:38.012079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:38.012111 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:38.015623 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.016441 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.016448 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.016452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.016608 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.017017 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.017021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.017023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.017356 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:38.017503 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.018309 (+ 806us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.018481 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":392,"thread_start_us":267,"threads_started":1}
I20260619 04:42:38.019762 24962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:37.997972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:46831)
0619 04:42:37.999042 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:37.999102 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:38.001107 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:38.001969 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:38.001999 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:38.002791 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:38.003495 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.003516 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.004796 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.004802 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.006633 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.006654 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.007814 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.007822 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.008140 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.008866 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:38.008892 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:38.011760 (+ 2868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:38.015834 (+ 4074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:38.015842 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:38.015857 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:38.016305 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:38.016714 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:38.016717 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:38.016719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:38.016904 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:38.017484 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:38.017492 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:38.017851 (+ 359us) client_negotiation.cc:769] Sending connection context
0619 04:42:38.018102 (+ 251us) client_negotiation.cc:240] Negotiation successful
0619 04:42:38.018584 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":473,"threads_started":1}
I20260619 04:42:38.021412 24958 heartbeater.cc:347] Connected to a master server at 127.9.224.126:38573
I20260619 04:42:38.021799 24958 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:38.022763 24958 heartbeater.cc:511] Master 127.9.224.126:38573 requested a full tablet report, sending...
I20260619 04:42:38.024626 24510 ts_manager.cc:194] Registered new tserver with Master: b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347)
I20260619 04:42:38.025734 24510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:46831
I20260619 04:42:38.027096 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:42:38.035569 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.028089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60396 (local address 127.9.224.126:38573)
0619 04:42:38.028316 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.028326 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.029584 (+ 1258us) server_negotiation.cc:407] Connection header received
0619 04:42:38.029699 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.029703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.029826 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.029950 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:42:38.030485 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.031403 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.032968 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.033587 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.033824 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.034381 (+ 557us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:42:38.034936 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:42:38.035059 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.035176 (+ 117us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.035246 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:42:38.036612 24509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:60396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:42:38.044214 24509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:42:38.068029 24695 heartbeater.cc:503] Master 127.9.224.126:38573 was elected leader, sending a full tablet report...
I20260619 04:42:38.086582 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.057676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34064 (local address 127.9.224.67:42347)
0619 04:42:38.072261 (+ 14585us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.072275 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.073889 (+ 1614us) server_negotiation.cc:407] Connection header received
0619 04:42:38.074367 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.074377 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.074665 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.074829 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:38.076088 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.078407 (+ 2319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.083634 (+ 5227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.085189 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.085327 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.085581 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.086047 (+ 466us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.086216 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14308,"thread_start_us":14595,"threads_started":1}
I20260619 04:42:38.086716 24970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.057173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:42347 (local address 127.0.0.1:34064)
0619 04:42:38.073617 (+ 16444us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.073765 (+ 148us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:38.074080 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:38.075169 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:38.075176 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:38.075216 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:38.075831 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.075854 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.078642 (+ 2788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.078651 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.083453 (+ 4802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.083474 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.085421 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.085427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.085669 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.085818 (+ 149us) client_negotiation.cc:769] Sending connection context
0619 04:42:38.085979 (+ 161us) client_negotiation.cc:240] Negotiation successful
0619 04:42:38.086181 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16244,"mutex_wait_us":244,"spinlock_wait_cycles":7424,"thread_start_us":16025,"threads_started":1}
I20260619 04:42:38.086932 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.056953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34676 (local address 127.9.224.66:40387)
0619 04:42:38.072996 (+ 16043us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.073009 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.073890 (+ 881us) server_negotiation.cc:407] Connection header received
0619 04:42:38.074367 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.074377 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.074655 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.074833 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:38.076697 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.078914 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.083701 (+ 4787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.085189 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.085327 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.085542 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.086419 (+ 877us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.086607 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15872,"thread_start_us":15732,"threads_started":1}
I20260619 04:42:38.087440 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.056860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:40387 (local address 127.0.0.1:34676)
0619 04:42:38.073617 (+ 16757us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.073765 (+ 148us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:38.074080 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:38.075169 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:38.075176 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:38.075216 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:38.076450 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.076475 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.079208 (+ 2733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.079217 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.083488 (+ 4271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.083501 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.085716 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.085721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.085896 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.085925 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 04:42:38.086045 (+ 120us) client_negotiation.cc:240] Negotiation successful
0619 04:42:38.086189 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16424,"mutex_wait_us":854,"spinlock_wait_cycles":19712,"thread_start_us":16244,"threads_started":1}
I20260619 04:42:38.090616 24972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.074232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52462)
0619 04:42:38.081653 (+ 7421us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.081669 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:38.081763 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:38.082994 (+ 1231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:38.082999 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:38.083031 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:38.083490 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.083501 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.084887 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.084894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.086942 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.086956 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.089860 (+ 2904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.089865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.090008 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.090032 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 04:42:38.090140 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 04:42:38.090298 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7307,"thread_start_us":8021,"threads_started":1}
I20260619 04:42:38.090739 24973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.074448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52462 (local address 127.9.224.65:36229)
0619 04:42:38.082437 (+ 7989us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.082446 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.082483 (+ 37us) server_negotiation.cc:407] Connection header received
0619 04:42:38.082573 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.082579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.082795 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.083003 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:38.083721 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.084745 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.087145 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.089391 (+ 2246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.089533 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.089740 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.090198 (+ 458us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.090409 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7758,"thread_start_us":7594,"threads_started":1}
I20260619 04:42:38.091706 24893 tablet_service.cc:1467] Processing CreateTablet for tablet 2413b282006344029822f730d5cf7c2c (DEFAULT_TABLE table=test-table [id=524f484c61b744ec8f9f5480e9ff0f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:38.091706 24762 tablet_service.cc:1467] Processing CreateTablet for tablet 2413b282006344029822f730d5cf7c2c (DEFAULT_TABLE table=test-table [id=524f484c61b744ec8f9f5480e9ff0f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:38.093252 24893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2413b282006344029822f730d5cf7c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:38.093256 24762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2413b282006344029822f730d5cf7c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:38.094331 24630 tablet_service.cc:1467] Processing CreateTablet for tablet 2413b282006344029822f730d5cf7c2c (DEFAULT_TABLE table=test-table [id=524f484c61b744ec8f9f5480e9ff0f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:42:38.095566 24630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2413b282006344029822f730d5cf7c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:38.109453 24974 tablet_bootstrap.cc:492] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Bootstrap starting.
I20260619 04:42:38.109988 24975 tablet_bootstrap.cc:492] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Bootstrap starting.
I20260619 04:42:38.113509 24975 tablet_bootstrap.cc:654] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:38.113511 24974 tablet_bootstrap.cc:654] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:38.114534 24976 tablet_bootstrap.cc:492] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Bootstrap starting.
I20260619 04:42:38.114979 24975 log.cc:824] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:38.114964 24974 log.cc:824] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:38.117952 24975 tablet_bootstrap.cc:492] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: No bootstrap required, opened a new log
I20260619 04:42:38.118302 24975 ts_tablet_manager.cc:1397] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260619 04:42:38.118485 24974 tablet_bootstrap.cc:492] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: No bootstrap required, opened a new log
I20260619 04:42:38.118594 24976 tablet_bootstrap.cc:654] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:38.118867 24974 ts_tablet_manager.cc:1397] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260619 04:42:38.119864 24976 log.cc:824] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:38.123140 24976 tablet_bootstrap.cc:492] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: No bootstrap required, opened a new log
I20260619 04:42:38.123409 24976 ts_tablet_manager.cc:1397] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260619 04:42:38.127086 24974 raft_consensus.cc:348] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.127555 24974 raft_consensus.cc:374] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:38.127664 24974 raft_consensus.cc:729] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a1936fac484c718d66647a695ba73a, State: Initialized, Role: FOLLOWER
I20260619 04:42:38.128309 24974 consensus_queue.cc:260] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.128556 24975 raft_consensus.cc:348] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.129030 24975 raft_consensus.cc:374] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:38.129170 24975 raft_consensus.cc:729] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab032ffc2b345e5b01bc7245da58619, State: Initialized, Role: FOLLOWER
I20260619 04:42:38.129786 24975 consensus_queue.cc:260] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.130117 24974 ts_tablet_manager.cc:1428] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260619 04:42:38.134961 24827 heartbeater.cc:503] Master 127.9.224.126:38573 was elected leader, sending a full tablet report...
I20260619 04:42:38.135298 24976 raft_consensus.cc:348] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.135742 24976 raft_consensus.cc:374] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:38.135847 24976 raft_consensus.cc:729] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65217d69f344bfb97e0984b1e442fca, State: Initialized, Role: FOLLOWER
I20260619 04:42:38.136479 24976 consensus_queue.cc:260] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.137156 24975 ts_tablet_manager.cc:1428] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Time spent starting tablet: real 0.019s user 0.011s sys 0.005s
I20260619 04:42:38.137697 24958 heartbeater.cc:503] Master 127.9.224.126:38573 was elected leader, sending a full tablet report...
I20260619 04:42:38.138274 24976 ts_tablet_manager.cc:1428] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260619 04:42:38.246443 24959 tablet.cc:2369] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:42:38.258018 24828 tablet.cc:2369] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:42:38.276607 24696 tablet.cc:2369] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:42:38.335892 24981 raft_consensus.cc:482] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:42:38.336174 24981 raft_consensus.cc:504] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.338045 24981 leader_election.cc:288] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347), 88a1936fac484c718d66647a695ba73a (127.9.224.65:36229)
I20260619 04:42:38.344720 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.338372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:35109 (local address 127.9.224.67:42347)
0619 04:42:38.338600 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.338608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.339347 (+ 739us) server_negotiation.cc:407] Connection header received
0619 04:42:38.339585 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.339589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.339646 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.339745 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:38.340288 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.341002 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.342898 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.343683 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.343882 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.343963 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.344328 (+ 365us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.344454 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:42:38.344745 24973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.338780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:44295 (local address 127.9.224.65:36229)
0619 04:42:38.338983 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.338991 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.339458 (+ 467us) server_negotiation.cc:407] Connection header received
0619 04:42:38.339638 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.339643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.339702 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.339799 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:42:38.340418 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.341114 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.342933 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.343726 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.343915 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.343994 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.344363 (+ 369us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.344492 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260619 04:42:38.344897 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.338482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.9.224.66:44295)
0619 04:42:38.339359 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.339374 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:38.339483 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:38.339812 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:38.339816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:38.339838 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:38.340271 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.340280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.341263 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.341273 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.342777 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.342788 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.343959 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.343965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.344206 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.344230 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 04:42:38.344336 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 04:42:38.344462 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":54,"thread_start_us":539,"threads_started":1}
I20260619 04:42:38.345171 24983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.338325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:42347 (local address 127.9.224.66:35109)
0619 04:42:38.339220 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.339251 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:38.339448 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:38.339763 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:38.339767 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:38.339790 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:42:38.340145 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.340157 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.341140 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.341145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.342751 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:38.342764 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.343923 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.343930 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:38.344155 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.344197 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 04:42:38.344303 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 04:42:38.344436 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"mutex_wait_us":47,"thread_start_us":652,"threads_started":1}
I20260619 04:42:38.346071 24650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2413b282006344029822f730d5cf7c2c" candidate_uuid: "3ab032ffc2b345e5b01bc7245da58619" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a1936fac484c718d66647a695ba73a" is_pre_election: true
I20260619 04:42:38.346068 24913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2413b282006344029822f730d5cf7c2c" candidate_uuid: "3ab032ffc2b345e5b01bc7245da58619" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65217d69f344bfb97e0984b1e442fca" is_pre_election: true
I20260619 04:42:38.346647 24913 raft_consensus.cc:2454] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ab032ffc2b345e5b01bc7245da58619 in term 0.
I20260619 04:42:38.346657 24650 raft_consensus.cc:2454] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ab032ffc2b345e5b01bc7245da58619 in term 0.
I20260619 04:42:38.347350 24715 leader_election.cc:302] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ab032ffc2b345e5b01bc7245da58619, b65217d69f344bfb97e0984b1e442fca; no voters:
I20260619 04:42:38.347757 24981 raft_consensus.cc:2781] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:42:38.347908 24981 raft_consensus.cc:482] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:42:38.348008 24981 raft_consensus.cc:3037] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:38.350183 24981 raft_consensus.cc:504] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.350891 24981 leader_election.cc:288] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [CANDIDATE]: Term 1 election: Requested vote from peers b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347), 88a1936fac484c718d66647a695ba73a (127.9.224.65:36229)
I20260619 04:42:38.351346 24913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2413b282006344029822f730d5cf7c2c" candidate_uuid: "3ab032ffc2b345e5b01bc7245da58619" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65217d69f344bfb97e0984b1e442fca"
I20260619 04:42:38.351428 24650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2413b282006344029822f730d5cf7c2c" candidate_uuid: "3ab032ffc2b345e5b01bc7245da58619" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a1936fac484c718d66647a695ba73a"
I20260619 04:42:38.351543 24913 raft_consensus.cc:3037] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:38.351720 24650 raft_consensus.cc:3037] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:38.353786 24913 raft_consensus.cc:2454] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ab032ffc2b345e5b01bc7245da58619 in term 1.
I20260619 04:42:38.353904 24650 raft_consensus.cc:2454] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ab032ffc2b345e5b01bc7245da58619 in term 1.
I20260619 04:42:38.354283 24715 leader_election.cc:302] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ab032ffc2b345e5b01bc7245da58619, b65217d69f344bfb97e0984b1e442fca; no voters:
I20260619 04:42:38.354668 24981 raft_consensus.cc:2781] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:38.355203 24981 raft_consensus.cc:686] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 1 LEADER]: Becoming Leader. State: Replica: 3ab032ffc2b345e5b01bc7245da58619, State: Running, Role: LEADER
I20260619 04:42:38.355791 24981 consensus_queue.cc:237] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } }
I20260619 04:42:38.360837 24509 catalog_manager.cc:5495] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "3ab032ffc2b345e5b01bc7245da58619" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ab032ffc2b345e5b01bc7245da58619" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 } health_report { overall_health: UNKNOWN } } }
I20260619 04:42:38.439994 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.434623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34686 (local address 127.9.224.66:40387)
0619 04:42:38.434859 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.434867 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.434886 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:42:38.434982 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.434985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.435061 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.435216 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:42:38.435598 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.436311 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.437785 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.438192 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.438373 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.438875 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:42:38.439383 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:42:38.439560 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.439642 (+ 82us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.439727 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:42:38.448820 24650 raft_consensus.cc:1261] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Refusing update from remote peer 3ab032ffc2b345e5b01bc7245da58619: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:38.448820 24913 raft_consensus.cc:1261] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Refusing update from remote peer 3ab032ffc2b345e5b01bc7245da58619: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:42:38.450065 24985 consensus_queue.cc:1035] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65217d69f344bfb97e0984b1e442fca" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:38.450538 24981 consensus_queue.cc:1035] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a1936fac484c718d66647a695ba73a" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 36229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:42:38.461747 24988 mvcc.cc:205] Tried to move back new op lower bound from 7298433672994803712 to 7298433672628830208. Current Snapshot: MvccSnapshot[applied={T|T < 7298433672994803712}]
I20260619 04:42:38.467834 24990 mvcc.cc:205] Tried to move back new op lower bound from 7298433672994803712 to 7298433672628830208. Current Snapshot: MvccSnapshot[applied={T|T < 7298433672994803712}]
I20260619 04:42:38.485787 24510 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:60396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:42:38.486073 24510 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:60396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:42:38.489960 24510 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Sending DeleteTablet for 3 replicas of tablet 2413b282006344029822f730d5cf7c2c
I20260619 04:42:38.491219 24762 tablet_service.cc:1514] Processing DeleteTablet for tablet 2413b282006344029822f730d5cf7c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:38 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:34676
I20260619 04:42:38.491604 24630 tablet_service.cc:1514] Processing DeleteTablet for tablet 2413b282006344029822f730d5cf7c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:38 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:52462
I20260619 04:42:38.491639 24893 tablet_service.cc:1514] Processing DeleteTablet for tablet 2413b282006344029822f730d5cf7c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:42:38 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:34064
I20260619 04:42:38.494464 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24547
I20260619 04:42:38.506340 24999 tablet_replica.cc:330] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: stopping tablet replica
I20260619 04:42:38.507493 24999 raft_consensus.cc:2229] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:42:38.509025 24999 raft_consensus.cc:2258] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:38.512312 24999 ts_tablet_manager.cc:1905] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:38.515532 25001 tablet_replica.cc:330] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: stopping tablet replica
I20260619 04:42:38.515978 25001 raft_consensus.cc:2229] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:42:38.516525 25001 raft_consensus.cc:2258] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:38.521822 24999 ts_tablet_manager.cc:1918] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:38.522091 24999 log.cc:1196] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/2413b282006344029822f730d5cf7c2c
I20260619 04:42:38.522737 24999 ts_tablet_manager.cc:1939] T 2413b282006344029822f730d5cf7c2c P 3ab032ffc2b345e5b01bc7245da58619: Deleting consensus metadata
I20260619 04:42:38.524663 24496 catalog_manager.cc:4841] TS 3ab032ffc2b345e5b01bc7245da58619 (127.9.224.66:40387): tablet 2413b282006344029822f730d5cf7c2c (table test-table [id=524f484c61b744ec8f9f5480e9ff0f6d]) successfully deleted
I20260619 04:42:38.525615 25000 tablet_replica.cc:330] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: stopping tablet replica
I20260619 04:42:38.526139 25000 raft_consensus.cc:2229] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:42:38.526846 25000 raft_consensus.cc:2258] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:42:38.528905 25001 ts_tablet_manager.cc:1905] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:38.532951 25000 ts_tablet_manager.cc:1905] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:38.536217 25001 ts_tablet_manager.cc:1918] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:38.536446 24973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.496189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52476 (local address 127.9.224.65:36229)
0619 04:42:38.496368 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.496374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.496393 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:42:38.496468 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.496476 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.496633 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.496754 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:38.499572 (+ 2818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.501156 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.509039 (+ 7883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.510011 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.510180 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.526491 (+ 16311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:38.527028 (+ 537us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:38.527050 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:38.527102 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:38.531534 (+ 4432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.532619 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.532629 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.532632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.532828 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.533326 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.533331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.533334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.533829 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:38.534165 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.535553 (+ 1388us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.535796 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:42:38.536442 25001 log.cc:1196] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/2413b282006344029822f730d5cf7c2c
I20260619 04:42:38.537014 25001 ts_tablet_manager.cc:1939] T 2413b282006344029822f730d5cf7c2c P b65217d69f344bfb97e0984b1e442fca: Deleting consensus metadata
I20260619 04:42:38.539057 24494 catalog_manager.cc:4841] TS b65217d69f344bfb97e0984b1e442fca (127.9.224.67:42347): tablet 2413b282006344029822f730d5cf7c2c (table test-table [id=524f484c61b744ec8f9f5480e9ff0f6d]) successfully deleted
I20260619 04:42:38.540103 24690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:38.638756 25000 ts_tablet_manager.cc:1918] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:38.639077 25000 log.cc:1196] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/2413b282006344029822f730d5cf7c2c
I20260619 04:42:38.639595 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24547
I20260619 04:42:38.658054 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24699
W20260619 04:42:38.658257 24496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.224.65:36229 (error 108)
I20260619 04:42:38.662297 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.659735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52488)
0619 04:42:38.661901 (+ 2166us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.662052 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2032,"thread_start_us":1939,"threads_started":1}
W20260619 04:42:38.662586 24496 catalog_manager.cc:4584] TS 88a1936fac484c718d66647a695ba73a (127.9.224.65:36229): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2413b282006344029822f730d5cf7c2c: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
I20260619 04:42:38.673923 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.659282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34690 (local address 127.9.224.66:40387)
0619 04:42:38.659457 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.659466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.659519 (+ 53us) server_negotiation.cc:407] Connection header received
0619 04:42:38.659588 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.659596 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.659681 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.659785 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:38.661631 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.662665 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.663976 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.664431 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.664591 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.667451 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:38.667466 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:38.667481 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:38.667531 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:38.671021 (+ 3490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.671777 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.671794 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.671796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.671941 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.672337 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.672343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.672347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.672703 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:38.673071 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.673327 (+ 256us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.673562 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260619 04:42:38.674752 24822 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:38.716686 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.716135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52502)
0619 04:42:38.716383 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.716514 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260619 04:42:38.717917 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.717456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52510)
0619 04:42:38.717645 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.717737 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260619 04:42:38.778787 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.778192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52514)
0619 04:42:38.778466 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.778562 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260619 04:42:38.779953 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.779580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52516)
0619 04:42:38.779743 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.779815 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260619 04:42:38.805267 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24699
I20260619 04:42:38.824945 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24830
I20260619 04:42:38.840416 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.825799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.9.224.67:42347)
0619 04:42:38.825990 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:38.825994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:38.826014 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:42:38.826294 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:38.826302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:38.826385 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:38.826506 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:38.828020 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.828833 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.830117 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:38.830681 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:38.830756 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:38.833674 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:38.833689 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:38.833722 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:38.833760 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:38.837100 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.837974 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.837982 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.837984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.838138 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:38.838809 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:38.838813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:38.838815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:38.839313 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:38.839634 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:38.839927 (+ 293us) server_negotiation.cc:299] Negotiation successful
0619 04:42:38.840118 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 04:42:38.841188 24953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:38.861182 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.860660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52532)
0619 04:42:38.860925 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.861024 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260619 04:42:38.862470 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:38.861992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52538)
0619 04:42:38.862188 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:38.862325 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260619 04:42:38.932161 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24830
I20260619 04:42:38.949766 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 24477
I20260619 04:42:38.951047 24540 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:39.064759 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 24477
I20260619 04:42:39.064863 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:39.064185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:36229 (local address 127.0.0.1:52542)
0619 04:42:39.064517 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:39.064665 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:36229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260619 04:42:39.087015 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38573
--webserver_interface=127.9.224.126
--webserver_port=40861
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:38573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:39.427109 25008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:39.427487 25008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:39.427667 25008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:39.435212 25008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:39.435405 25008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:39.435513 25008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:39.435626 25008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:39.435695 25008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:39.446110 25008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:38573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=40861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:39.447669 25008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:39.449090 25008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:39.461490 25016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:39.461493 25013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:39.461493 25014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:39.462379 25008 server_base.cc:1034] running on GCE node
I20260619 04:42:39.463215 25008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:39.464740 25008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:39.465984 25008 hybrid_clock.cc:648] HybridClock initialized: now 1781844159465940 us; error 58 us; skew 500 ppm
I20260619 04:42:39.466418 25008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:39 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844159, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:39.469537 25008 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:39.471083 25008 webserver.cc:460] Webserver started at http://127.9.224.126:40861/ using document root <none> and password file <none>
I20260619 04:42:39.471803 25008 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:39.471949 25008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:39.477587 25008 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 04:42:39.481957 25023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:39.483510 25008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:42:39.483711 25008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "88d46001e501490294203af47316a2f0"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "eb9585d37df40efa5cd923581f18450b"
server_key_iv: "0fb6c69d3c312f48f77d2e140e841bf7"
server_key_version: "encryptionkey@0"
I20260619 04:42:39.484774 25008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:39.502730 25008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:39.508219 25008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:39.508517 25008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:39.526731 25008 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:38573
I20260619 04:42:39.526757 25074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:38573 every 8 connection(s)
I20260619 04:42:39.528416 25008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:39.530885 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25008
I20260619 04:42:39.531739 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:36229
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:38573
--webserver_port=35805
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:42:39.535715 25075 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:42:39.539095 25075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap starting.
I20260619 04:42:39.559650 25075 log.cc:824] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Log is configured to *not* fsync() on all Append() calls
I20260619 04:42:39.576056 25075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:42:39.576653 25075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0: Bootstrap complete.
I20260619 04:42:39.585848 25075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:39.586849 25075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88d46001e501490294203af47316a2f0, State: Initialized, Role: FOLLOWER
I20260619 04:42:39.587555 25075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:39.587790 25075 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:39.587908 25075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:39.588114 25075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 2 FOLLOWER]: Advancing to term 3
I20260619 04:42:39.592139 25075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:39.592645 25075 leader_election.cc:302] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88d46001e501490294203af47316a2f0; no voters:
I20260619 04:42:39.593336 25075 leader_election.cc:288] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260619 04:42:39.593483 25079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 04:42:39.594624 25079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [term 3 LEADER]: Becoming Leader. State: Replica: 88d46001e501490294203af47316a2f0, State: Running, Role: LEADER
I20260619 04:42:39.595245 25079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } }
I20260619 04:42:39.595587 25075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:39.597827 25081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88d46001e501490294203af47316a2f0. Latest consensus state: current_term: 3 leader_uuid: "88d46001e501490294203af47316a2f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } } }
I20260619 04:42:39.598202 25081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:39.598017 25080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "88d46001e501490294203af47316a2f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88d46001e501490294203af47316a2f0" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38573 } } }
I20260619 04:42:39.598416 25080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88d46001e501490294203af47316a2f0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:39.607985 25086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:39.619555 25086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:39.621743 25086 catalog_manager.cc:1259] Loaded cluster ID: 9ea5706d95504501960017e318d4d5f2
I20260619 04:42:39.621943 25086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260619 04:42:39.624773 25086 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8c52f289ad google::LogMessage::Fail() at ??:0
@ 0x7f8c52f2b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8c52f284de google::LogMessage::Flush() at ??:0
@ 0x7f8c52f29a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8c6895f512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f8c6895c976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8c689e4610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f8c689e4439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8c55b74345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8c55b7791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8c55b77799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8c55b52eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8c58e2c6db start_thread at ??:0
@ 0x7f8c51dc261f clone at ??:0
W20260619 04:42:39.938774 25077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:39.939069 25077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:39.939240 25077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:39.948734 25077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:39.948894 25077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:39.949126 25077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:42:39.961328 25077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:36229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=35805
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:39.962772 25077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:39.964104 25077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:39.977674 25116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:39.977747 25117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:39.977638 25119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:39.979147 25077 server_base.cc:1034] running on GCE node
I20260619 04:42:39.979772 25077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:39.980832 25077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:39.982088 25077 hybrid_clock.cc:648] HybridClock initialized: now 1781844159982026 us; error 54 us; skew 500 ppm
I20260619 04:42:39.982506 25077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:39 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844159, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:39.985937 25077 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:42:39.987530 25077 webserver.cc:460] Webserver started at http://127.9.224.65:35805/ using document root <none> and password file <none>
I20260619 04:42:39.988201 25077 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:39.988302 25077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:39.993765 25077 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 04:42:39.996560 25126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:39.997992 25077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 04:42:39.998142 25077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "88a1936fac484c718d66647a695ba73a"
format_stamp: "Formatted at 2026-06-19 04:42:33 on dist-test-slave-9dgf"
server_key: "92dc335b58a749b1e61143dcec5579f6"
server_key_iv: "7ff4c8da92965cf9cfda97c6e1dbf391"
server_key_version: "encryptionkey@0"
I20260619 04:42:39.999259 25077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:40.012717 25077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:40.017207 25077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:40.017473 25077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:40.018487 25077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:40.020358 25133 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260619 04:42:40.026031 25133 ts_tablet_manager.cc:1852] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260619 04:42:40.027160 25133 ts_tablet_manager.cc:1905] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:42:40.034955 25133 ts_tablet_manager.cc:1918] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:42:40.035291 25133 ts_tablet_manager.cc:1939] T 2413b282006344029822f730d5cf7c2c P 88a1936fac484c718d66647a695ba73a: Deleting consensus metadata
I20260619 04:42:40.035741 25077 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260619 04:42:40.035907 25077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.000s sys 0.001s
I20260619 04:42:40.036077 25077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:40.036191 25077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:40.071625 25077 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:36229
I20260619 04:42:40.071681 25239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:36229 every 8 connection(s)
I20260619 04:42:40.073028 25077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:42:40.077188 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25077
I20260619 04:42:40.077939 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:40387
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:38573
--webserver_port=40585
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:42:40.078485 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:40.076212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:40937)
0619 04:42:40.077052 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:40.077356 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":364,"threads_started":1}
W20260619 04:42:40.079267 25240 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:38573 (0 consecutive failures): Network error: Failed to ping master at 127.9.224.126:38573: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
I20260619 04:42:40.080200 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:40.079847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:58673)
0619 04:42:40.080010 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:40.080096 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260619 04:42:40.081262 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:40.080875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:33981)
0619 04:42:40.081026 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:40.081131 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260619 04:42:40.081544 25240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 04:42:40.419591 25243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:40.419902 25243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:40.420001 25243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:40.427551 25243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:40.427695 25243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:40.427812 25243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:42:40.437878 25243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:40387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=40585
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:40.439270 25243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:40.440582 25243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:40.454921 25249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:40.454941 25251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:40.455014 25248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:40.455711 25243 server_base.cc:1034] running on GCE node
I20260619 04:42:40.456404 25243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:40.457432 25243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:40.458669 25243 hybrid_clock.cc:648] HybridClock initialized: now 1781844160458619 us; error 47 us; skew 500 ppm
I20260619 04:42:40.459002 25243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:40 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844160, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:40.462304 25243 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:42:40.463824 25243 webserver.cc:460] Webserver started at http://127.9.224.66:40585/ using document root <none> and password file <none>
I20260619 04:42:40.464488 25243 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:40.464588 25243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:40.469957 25243 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:42:40.472719 25258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:40.474169 25243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:42:40.474396 25243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "3ab032ffc2b345e5b01bc7245da58619"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "fa2e23469522393e8f34a757bb55ddb4"
server_key_iv: "dc640eca9ef0c6153acd7627decdaaab"
server_key_version: "encryptionkey@0"
I20260619 04:42:40.475435 25243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:40.499974 25243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:40.504817 25243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:40.505048 25243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:40.505975 25243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:40.507381 25243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:40.507486 25243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:40.507565 25243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:40.507632 25243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:40.542855 25243 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:40387
I20260619 04:42:40.542905 25370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:40387 every 8 connection(s)
I20260619 04:42:40.544375 25243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:42:40.549196 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:40.547315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:41495)
0619 04:42:40.548106 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:40.548353 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":333,"threads_started":1}
W20260619 04:42:40.549938 25371 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:38573 (0 consecutive failures): Network error: Failed to ping master at 127.9.224.126:38573: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
I20260619 04:42:40.550814 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:40.550461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:38163)
0619 04:42:40.550606 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:40.550709 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260619 04:42:40.551735 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:40.551397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:37335)
0619 04:42:40.551514 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:40.551584 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260619 04:42:40.552028 25371 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 04:42:40.553364 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25243
I20260619 04:42:40.554005 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:42347
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:38573
--webserver_port=44483
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:40.894506 25374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:40.894851 25374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:40.895021 25374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:40.902410 25374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:40.902570 25374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:40.902801 25374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:42:40.913139 25374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:42347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=44483
--tserver_master_addrs=127.9.224.126:38573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:40.914708 25374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:40.916169 25374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:40.929927 25379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:40.929891 25382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:40.929986 25380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:40.931334 25374 server_base.cc:1034] running on GCE node
I20260619 04:42:40.931928 25374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:40.932886 25374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:40.934103 25374 hybrid_clock.cc:648] HybridClock initialized: now 1781844160934059 us; error 26 us; skew 500 ppm
I20260619 04:42:40.934548 25374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:40 dist-test-slave-9dgf krb5kdc[23923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844160, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:40.937776 25374 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:42:40.939321 25374 webserver.cc:460] Webserver started at http://127.9.224.67:44483/ using document root <none> and password file <none>
I20260619 04:42:40.940058 25374 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:40.940220 25374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:40.945906 25374 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 04:42:40.948884 25389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:40.950466 25374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:42:40.950659 25374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "b65217d69f344bfb97e0984b1e442fca"
format_stamp: "Formatted at 2026-06-19 04:42:34 on dist-test-slave-9dgf"
server_key: "11162b138c984edd41974fa66f01805c"
server_key_iv: "b188e60b9d1154e5289626ee44b00036"
server_key_version: "encryptionkey@0"
I20260619 04:42:40.951699 25374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:40.975584 25374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:40.980070 25374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:40.980373 25374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:40.981340 25374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:40.982710 25374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:40.982836 25374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:40.982965 25374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:40.983052 25374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:41.016664 25374 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:42347
I20260619 04:42:41.016752 25501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:42347 every 8 connection(s)
I20260619 04:42:41.018265 25374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:42:41.023447 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:41.021379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:40635)
0619 04:42:41.022140 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:41.022448 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":300,"threads_started":1}
W20260619 04:42:41.024142 25502 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:38573 (0 consecutive failures): Network error: Failed to ping master at 127.9.224.126:38573: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
I20260619 04:42:41.024927 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:41.024610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:52081)
0619 04:42:41.024752 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:41.024824 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260619 04:42:41.025779 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:41.025493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:38311)
0619 04:42:41.025611 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:41.025679 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260619 04:42:41.026036 25502 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 04:42:41.028445 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25374
I20260619 04:42:41.082917 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:41.082049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:48167)
0619 04:42:41.082579 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:41.082700 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":282,"threads_started":1}
I20260619 04:42:41.553951 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:41.552671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:49387)
0619 04:42:41.553309 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:41.553446 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":287,"threads_started":1}
I20260619 04:42:42.027554 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:42.026671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:55901)
0619 04:42:42.027173 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:42.027303 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":239,"threads_started":1}
I20260619 04:42:42.084893 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:42.083994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:52301)
0619 04:42:42.084565 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:42.084661 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":317,"threads_started":1}
I20260619 04:42:42.555923 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:42.555078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:37151)
0619 04:42:42.555658 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:42.555747 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":362,"threads_started":1}
I20260619 04:42:43.029428 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:43.028606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:56455)
0619 04:42:43.029134 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:43.029222 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":294,"threads_started":1}
I20260619 04:42:43.087016 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:43.086075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:49479)
0619 04:42:43.086691 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:43.086795 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":351,"threads_started":1}
I20260619 04:42:43.557623 25513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:43.556874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:48995)
0619 04:42:43.557336 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:43.557436 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":225,"threads_started":1}
I20260619 04:42:44.031155 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:44.030384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:35605)
0619 04:42:44.030886 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:44.030976 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":241,"threads_started":1}
I20260619 04:42:44.088728 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:44.087978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:56495)
0619 04:42:44.088449 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:44.088546 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":232,"threads_started":1}
I20260619 04:42:44.559398 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:44.558624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:45251)
0619 04:42:44.559129 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:44.559220 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":264,"threads_started":1}
I20260619 04:42:45.032835 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:45.032078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:59323)
0619 04:42:45.032555 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:45.032640 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":227,"threads_started":1}
I20260619 04:42:45.090533 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:45.089736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:47321)
0619 04:42:45.090219 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:45.090373 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":254,"threads_started":1}
I20260619 04:42:45.561038 25519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:45.560302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:54991)
0619 04:42:45.560746 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:45.560833 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":227,"threads_started":1}
I20260619 04:42:46.034957 25520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:46.033885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:60071)
0619 04:42:46.034590 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:46.034690 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":354,"threads_started":1}
I20260619 04:42:46.092268 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:46.091499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:40805)
0619 04:42:46.092010 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:46.092090 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":280,"threads_started":1}
I20260619 04:42:46.562783 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:46.561981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:57589)
0619 04:42:46.562487 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:46.562613 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":288,"threads_started":1}
I20260619 04:42:47.036826 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:47.035914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:57665)
0619 04:42:47.036452 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:47.036603 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":302,"threads_started":1}
I20260619 04:42:47.094122 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:47.093298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:56351)
0619 04:42:47.093813 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:47.093891 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":246,"threads_started":1}
I20260619 04:42:47.564759 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:47.563767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:57241)
0619 04:42:47.564319 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:47.564467 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":252,"threads_started":1}
I20260619 04:42:48.038982 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:48.037942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:44611)
0619 04:42:48.038625 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:48.038714 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":391,"threads_started":1}
I20260619 04:42:48.095993 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:48.095100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:59477)
0619 04:42:48.095670 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:48.095757 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":302,"threads_started":1}
I20260619 04:42:48.566859 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:48.565991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:60323)
0619 04:42:48.566583 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:48.566683 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":330,"threads_started":1}
I20260619 04:42:49.040758 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:49.040023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:53477)
0619 04:42:49.040501 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:49.040592 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":243,"threads_started":1}
I20260619 04:42:49.097774 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:49.096983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:53481)
0619 04:42:49.097503 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:49.097614 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":231,"threads_started":1}
I20260619 04:42:49.568799 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:49.567909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:32847)
0619 04:42:49.568407 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:49.568555 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":240,"threads_started":1}
I20260619 04:42:50.042737 25532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:50.041862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:34187)
0619 04:42:50.042465 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:50.042556 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":253,"threads_started":1}
I20260619 04:42:50.099932 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:50.098959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:59829)
0619 04:42:50.099504 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:50.099630 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":225,"threads_started":1}
I20260619 04:42:50.570712 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:50.569867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:55531)
0619 04:42:50.570445 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:50.570545 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":298,"threads_started":1}
I20260619 04:42:51.044447 25535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:51.043742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:44827)
0619 04:42:51.044202 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:51.044289 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":250,"threads_started":1}
I20260619 04:42:51.101958 25536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:51.101035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:41141)
0619 04:42:51.101607 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:51.101719 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":282,"threads_started":1}
I20260619 04:42:51.572465 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:51.571702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:59741)
0619 04:42:51.572175 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:51.572281 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":225,"threads_started":1}
I20260619 04:42:52.046126 25538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:52.045347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:47783)
0619 04:42:52.045825 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:52.045931 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":234,"threads_started":1}
I20260619 04:42:52.103799 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:52.102977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:47247)
0619 04:42:52.103465 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:52.103562 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":242,"threads_started":1}
I20260619 04:42:52.574415 25540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:52.573582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:40075)
0619 04:42:52.574025 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:52.574167 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":223,"threads_started":1}
I20260619 04:42:53.047873 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:53.047156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:40597)
0619 04:42:53.047623 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:53.047714 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":223,"threads_started":1}
I20260619 04:42:53.105615 25542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:53.104744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:44917)
0619 04:42:53.105319 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:53.105426 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":300,"threads_started":1}
I20260619 04:42:53.576328 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:53.575513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:33517)
0619 04:42:53.576018 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:53.576125 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":232,"threads_started":1}
I20260619 04:42:54.049943 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:54.049005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:57477)
0619 04:42:54.049578 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:54.049686 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":287,"threads_started":1}
I20260619 04:42:54.107364 25545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:54.106593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:50343)
0619 04:42:54.107073 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:54.107167 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":239,"threads_started":1}
I20260619 04:42:54.577983 25546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:54.577245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:45629)
0619 04:42:54.577696 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:54.577790 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":219,"threads_started":1}
I20260619 04:42:55.051787 25547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:55.051021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:45601)
0619 04:42:55.051508 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:55.051594 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":264,"threads_started":1}
I20260619 04:42:55.109297 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:55.108527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.65:53205)
0619 04:42:55.109021 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:55.109128 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":232,"threads_started":1}
I20260619 04:42:55.580161 25549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:55.579299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.66:60265)
0619 04:42:55.579804 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:55.579922 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":275,"threads_started":1}
I20260619 04:42:56.039768 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25077
I20260619 04:42:56.053963 25551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:56.053063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:38573 (local address 127.9.224.67:51413)
0619 04:42:56.053620 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:56.053745 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":256,"threads_started":1}
I20260619 04:42:56.059417 25550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:56.040915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59762 (local address 127.9.224.65:36229)
0619 04:42:56.041557 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:56.041577 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:56.041623 (+ 46us) server_negotiation.cc:407] Connection header received
0619 04:42:56.044110 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:56.044122 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:56.044591 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:56.044915 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:56.046405 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:56.047598 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:56.048885 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:56.049564 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:56.049698 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:56.052497 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:56.052506 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:56.052524 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:56.052563 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:56.056099 (+ 3536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:56.056883 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:56.056890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:56.056897 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:56.057118 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:56.057443 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:56.057448 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:56.057451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:56.058103 (+ 652us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:56.058392 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:56.058741 (+ 349us) server_negotiation.cc:299] Negotiation successful
0619 04:42:56.059115 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":313,"threads_started":1}
I20260619 04:42:56.060801 25235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:56.155493 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25077
I20260619 04:42:56.172698 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25243
I20260619 04:42:56.191406 25554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:56.173763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47336 (local address 127.9.224.66:40387)
0619 04:42:56.174393 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:56.174407 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:56.174453 (+ 46us) server_negotiation.cc:407] Connection header received
0619 04:42:56.176081 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:56.176090 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:56.176553 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:56.176913 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:56.178386 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:56.179649 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:56.180936 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:56.181648 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:56.181856 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:56.184748 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:56.184756 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:56.184772 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:56.184819 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:56.187729 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:56.188549 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:56.188556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:56.188563 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:56.188820 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:56.189231 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:56.189237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:56.189240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:56.189812 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:56.190140 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:56.190664 (+ 524us) server_negotiation.cc:299] Negotiation successful
0619 04:42:56.191110 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":284,"threads_started":1}
I20260619 04:42:56.192864 25366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:56.279683 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25243
I20260619 04:42:56.297598 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25374
I20260619 04:42:56.316344 25556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:56.298754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33756 (local address 127.9.224.67:42347)
0619 04:42:56.299423 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:56.299438 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:56.299480 (+ 42us) server_negotiation.cc:407] Connection header received
0619 04:42:56.301146 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:56.301155 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:56.301603 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:56.301911 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:56.303593 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:56.304835 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:56.306176 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:56.306985 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:56.307117 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:56.309812 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:56.309820 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:56.309836 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:56.309874 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:56.312857 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:56.313523 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:56.313530 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:56.313538 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:56.313709 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:56.314134 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:56.314138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:56.314140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:56.314831 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:56.315110 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:56.315491 (+ 381us) server_negotiation.cc:299] Negotiation successful
0619 04:42:56.316028 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":319,"threads_started":1}
I20260619 04:42:56.317907 25497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:42:56.403705 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25374
2026-06-19T04:42:56Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25136 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:42:56 dist-test-slave-9dgf krb5kdc[25560](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:42:56 dist-test-slave-9dgf krb5kdc[25560](info): set up 2 sockets
Jun 19 04:42:56 dist-test-slave-9dgf krb5kdc[25560](info): commencing operation
krb5kdc: starting...
W20260619 04:42:57.527025 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:42:57 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:42:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:42:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:42:57.786566 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36203
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:58.135845 25573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:58.136240 25573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:58.136416 25573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:58.143827 25573 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 04:42:58.143980 25573 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 04:42:58.144065 25573 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 04:42:58.144145 25573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:42:58.144232 25573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:58.144331 25573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:58.144423 25573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:42:58.144501 25573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:42:58.154667 25573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:58.156111 25573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:58.157548 25573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:58.170665 25578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:58.170902 25573 server_base.cc:1034] running on GCE node
W20260619 04:42:58.170665 25581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:58.171216 25579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:58.172178 25573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:58.173692 25573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:58.174924 25573 hybrid_clock.cc:648] HybridClock initialized: now 1781844178174828 us; error 67 us; skew 500 ppm
I20260619 04:42:58.175338 25573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:58 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844178, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:58.183204 25573 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:42:58.184937 25573 webserver.cc:460] Webserver started at http://127.9.224.126:40679/ using document root <none> and password file <none>
I20260619 04:42:58.185701 25573 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:58.185797 25573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:58.186093 25573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:58.189483 25573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "c70ffb469e044de6bc18240b4d95a800"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "7394029d44beb34ca00a73ff1322b0ea"
server_key_iv: "a584e0c3f9940259a3135d477cb724ad"
server_key_version: "encryptionkey@0"
I20260619 04:42:58.190374 25573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "c70ffb469e044de6bc18240b4d95a800"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "7394029d44beb34ca00a73ff1322b0ea"
server_key_iv: "a584e0c3f9940259a3135d477cb724ad"
server_key_version: "encryptionkey@0"
I20260619 04:42:58.195943 25573 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260619 04:42:58.199868 25588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:58.201467 25573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:42:58.201658 25573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "c70ffb469e044de6bc18240b4d95a800"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "7394029d44beb34ca00a73ff1322b0ea"
server_key_iv: "a584e0c3f9940259a3135d477cb724ad"
server_key_version: "encryptionkey@0"
I20260619 04:42:58.201886 25573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:58.229017 25573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:58.233995 25573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:58.234323 25573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:58.253755 25573 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36203
I20260619 04:42:58.253777 25639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36203 every 8 connection(s)
I20260619 04:42:58.255311 25573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:42:58.259266 25640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:42:58.262326 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25573
I20260619 04:42:58.262567 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:42:58.263391 10113 external_mini_cluster.cc:1428] Setting key 59be28b76e9499668a2059d539089ac0
I20260619 04:42:58.273550 25640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap starting.
I20260619 04:42:58.277714 25640 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Neither blocks nor log segments found. Creating new log.
I20260619 04:42:58.279204 25640 log.cc:824] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Log is configured to *not* fsync() on all Append() calls
Jun 19 04:42:58 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:58.283020 25640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: No bootstrap required, opened a new log
I20260619 04:42:58.290516 25643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:58.266020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36468 (local address 127.9.224.126:36203)
0619 04:42:58.267253 (+ 1233us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:58.267267 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:58.267310 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:42:58.269036 (+ 1726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:58.269061 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:58.269501 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:58.269860 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:58.271788 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:58.273235 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:58.275293 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:58.276060 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:58.276197 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:58.281784 (+ 5587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:58.281792 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:58.281808 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:58.281854 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:58.285382 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:58.286371 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:58.286378 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:58.286389 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:58.286594 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:58.287223 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:58.287228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:58.287230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:58.287885 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:58.288236 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:58.288747 (+ 511us) server_negotiation.cc:299] Negotiation successful
0619 04:42:58.289250 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":992,"thread_start_us":690,"threads_started":1}
I20260619 04:42:58.292737 25640 raft_consensus.cc:348] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:42:58.293155 25640 raft_consensus.cc:374] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:42:58.293283 25640 raft_consensus.cc:729] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70ffb469e044de6bc18240b4d95a800, State: Initialized, Role: FOLLOWER
I20260619 04:42:58.293980 25640 consensus_queue.cc:260] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:42:58.294283 25640 raft_consensus.cc:388] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:42:58.294473 25640 raft_consensus.cc:482] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:42:58.294657 25640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:42:58.297220 25640 raft_consensus.cc:504] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:42:58.297778 25640 leader_election.cc:302] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c70ffb469e044de6bc18240b4d95a800; no voters:
I20260619 04:42:58.298485 25640 leader_election.cc:288] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:42:58.298616 25645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:42:58.299376 25645 raft_consensus.cc:686] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 LEADER]: Becoming Leader. State: Replica: c70ffb469e044de6bc18240b4d95a800, State: Running, Role: LEADER
I20260619 04:42:58.300040 25645 consensus_queue.cc:237] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:42:58.301040 25640 sys_catalog.cc:564] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:42:58.303382 25646 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c70ffb469e044de6bc18240b4d95a800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } } }
I20260619 04:42:58.303896 25646 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:58.303939 25647 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c70ffb469e044de6bc18240b4d95a800. Latest consensus state: current_term: 1 leader_uuid: "c70ffb469e044de6bc18240b4d95a800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } } }
I20260619 04:42:58.304332 25647 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: This master's current role is: LEADER
I20260619 04:42:58.307127 25654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:42:58.312325 25654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:42:58.322362 25654 catalog_manager.cc:1347] Generated new cluster ID: 13468089f1434e7797f144e2e3a2dc9d
I20260619 04:42:58.322503 25654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:42:58.337958 25654 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:42:58.340047 25654 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:42:58.350767 25654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Generated new TSK 0
I20260619 04:42:58.351910 25654 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:42:58.423877 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36203
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:58.779407 25666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:58.779721 25666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:58.779824 25666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:58.787297 25666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:58.787422 25666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:58.787539 25666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:42:58.797778 25666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:58.799129 25666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:58.800467 25666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:58.815114 25672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:58.815207 25671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:58.815207 25674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:58.816083 25666 server_base.cc:1034] running on GCE node
I20260619 04:42:58.816767 25666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:58.817838 25666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:58.819088 25666 hybrid_clock.cc:648] HybridClock initialized: now 1781844178819036 us; error 58 us; skew 500 ppm
I20260619 04:42:58.819440 25666 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:58 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844178, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:58.822721 25666 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:42:58.824221 25666 webserver.cc:460] Webserver started at http://127.9.224.65:40539/ using document root <none> and password file <none>
I20260619 04:42:58.824939 25666 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:58.825086 25666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:58.825397 25666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:58.828604 25666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "2f0d5ff148068d5de447e1ebd0b2bd6c"
server_key_iv: "c6f58f396e8f791355f3a4c171b8efa1"
server_key_version: "encryptionkey@0"
I20260619 04:42:58.829392 25666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "2f0d5ff148068d5de447e1ebd0b2bd6c"
server_key_iv: "c6f58f396e8f791355f3a4c171b8efa1"
server_key_version: "encryptionkey@0"
I20260619 04:42:58.834878 25666 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:42:58.838814 25681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:58.840384 25666 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:42:58.840600 25666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "2f0d5ff148068d5de447e1ebd0b2bd6c"
server_key_iv: "c6f58f396e8f791355f3a4c171b8efa1"
server_key_version: "encryptionkey@0"
I20260619 04:42:58.840826 25666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:58.861997 25666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:58.866639 25666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:58.866953 25666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:58.867969 25666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:58.869365 25666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:58.869478 25666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:58.869626 25666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:58.869701 25666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:58.905006 25666 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:46087
I20260619 04:42:58.905043 25793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:46087 every 8 connection(s)
I20260619 04:42:58.906625 25666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:42:58.909848 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25666
I20260619 04:42:58.910068 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:42:58.910759 10113 external_mini_cluster.cc:1428] Setting key 052775db622ca777ce6dcbc1fa989746
Jun 19 04:42:58 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844178, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:58.930675 25796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:58.909384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:52795 (local address 127.9.224.126:36203)
0619 04:42:58.909898 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:58.909905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:58.911169 (+ 1264us) server_negotiation.cc:407] Connection header received
0619 04:42:58.913071 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:58.913077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:58.913158 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:58.913288 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:58.914993 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:58.916133 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:58.917845 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:58.918598 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:58.918741 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:58.922996 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:58.923006 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:58.923014 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:58.923064 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:58.926828 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:58.927702 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:58.927711 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:58.927718 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:58.927878 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:58.928417 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:58.928425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:58.928431 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:58.928861 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:58.929022 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:58.929864 (+ 842us) server_negotiation.cc:299] Negotiation successful
0619 04:42:58.930146 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":233,"threads_started":1}
I20260619 04:42:58.931547 25797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:58.910054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:52795)
0619 04:42:58.910983 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:58.911038 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:58.912795 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:58.913543 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:58.913552 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:58.914134 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:58.914804 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:58.914822 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:58.916317 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:58.916321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:58.917689 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:58.917702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:58.918842 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:58.918848 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:58.919104 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:58.919896 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:58.919924 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:58.922735 (+ 2811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:58.927018 (+ 4283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:58.927026 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:58.927041 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:58.927551 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:58.928032 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:58.928036 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:58.928039 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:58.928257 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:58.929043 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:58.929051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:58.929428 (+ 377us) client_negotiation.cc:769] Sending connection context
0619 04:42:58.929695 (+ 267us) client_negotiation.cc:240] Negotiation successful
0619 04:42:58.930164 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":410,"threads_started":1}
I20260619 04:42:58.933573 25794 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36203
I20260619 04:42:58.933956 25794 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:58.935022 25794 heartbeater.cc:511] Master 127.9.224.126:36203 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
I20260619 04:42:58.937872 25605 ts_manager.cc:194] Registered new tserver with Master: 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65:46087)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
I20260619 04:42:58.939697 25605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:52795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:42:58.972049 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36203
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:59.308075 25800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:59.308368 25800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:59.308528 25800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:59.316159 25800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:59.316283 25800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:59.316458 25800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:42:59.326948 25800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:59.328365 25800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:59.329710 25800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:59.344141 25805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:59.344238 25808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:59.344477 25806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:59.345191 25800 server_base.cc:1034] running on GCE node
I20260619 04:42:59.345857 25800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:59.347083 25800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:59.348311 25800 hybrid_clock.cc:648] HybridClock initialized: now 1781844179348258 us; error 39 us; skew 500 ppm
I20260619 04:42:59.348695 25800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:59 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844179, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:59.352464 25800 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:42:59.354100 25800 webserver.cc:460] Webserver started at http://127.9.224.66:38777/ using document root <none> and password file <none>
I20260619 04:42:59.354908 25800 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:59.355029 25800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:59.355316 25800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:59.358768 25800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "74aab8a009f14fec832d72a7932d4eae"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d709c33fb810e165faa7acb520607c5a"
server_key_iv: "e32d63eb8d5296c90f594ef8a08406c2"
server_key_version: "encryptionkey@0"
I20260619 04:42:59.359589 25800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "74aab8a009f14fec832d72a7932d4eae"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d709c33fb810e165faa7acb520607c5a"
server_key_iv: "e32d63eb8d5296c90f594ef8a08406c2"
server_key_version: "encryptionkey@0"
I20260619 04:42:59.365525 25800 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260619 04:42:59.369664 25815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:59.371354 25800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 04:42:59.371577 25800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "74aab8a009f14fec832d72a7932d4eae"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d709c33fb810e165faa7acb520607c5a"
server_key_iv: "e32d63eb8d5296c90f594ef8a08406c2"
server_key_version: "encryptionkey@0"
I20260619 04:42:59.371812 25800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:59.385519 25800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:59.390862 25800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:59.391229 25800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:59.392350 25800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:59.393898 25800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:59.394022 25800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:59.394191 25800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:59.394295 25800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260619 04:42:59.430475 25800 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:46449
I20260619 04:42:59.430517 25927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:46449 every 8 connection(s)
I20260619 04:42:59.431844 25800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:42:59.437688 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25800
I20260619 04:42:59.437888 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:42:59.438446 10113 external_mini_cluster.cc:1428] Setting key fd23e915923acb4fd08d869f0a4a5670
Jun 19 04:42:59 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844179, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:59.454537 25930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:59.434825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:34579 (local address 127.9.224.126:36203)
0619 04:42:59.435322 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:59.435328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:59.436546 (+ 1218us) server_negotiation.cc:407] Connection header received
0619 04:42:59.438706 (+ 2160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:59.438711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:59.438812 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:59.438936 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:59.440809 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.441561 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.443247 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.443687 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.443832 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:59.447713 (+ 3881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:59.447718 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:59.447722 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:59.447758 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:59.451085 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:59.451996 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:59.452001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:59.452003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:59.452143 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:59.452642 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:59.452647 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:59.452649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:59.452929 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:59.453102 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:59.453853 (+ 751us) server_negotiation.cc:299] Negotiation successful
0619 04:42:59.454109 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":270,"threads_started":1}
I20260619 04:42:59.455591 25931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:59.435494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:34579)
0619 04:42:59.436333 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:59.436374 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:59.438370 (+ 1996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:59.439203 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:59.439212 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:59.439937 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:59.440638 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:59.440656 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.441733 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.441737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:59.443095 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:59.443112 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.443926 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.443934 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:59.444181 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:59.444976 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:59.445000 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:59.447437 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:59.451276 (+ 3839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:59.451287 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:59.451316 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:59.451824 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:59.452269 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:59.452275 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:59.452279 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:59.452502 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:59.453077 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:59.453087 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:59.453466 (+ 379us) client_negotiation.cc:769] Sending connection context
0619 04:42:59.453755 (+ 289us) client_negotiation.cc:240] Negotiation successful
0619 04:42:59.454363 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":319,"threads_started":1}
I20260619 04:42:59.457284 25928 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36203
I20260619 04:42:59.457686 25928 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:59.458559 25928 heartbeater.cc:511] Master 127.9.224.126:36203 requested a full tablet report, sending...
I20260619 04:42:59.460217 25605 ts_manager.cc:194] Registered new tserver with Master: 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
I20260619 04:42:59.461107 25605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:34579
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:42:59.498591 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36203
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:42:59.846344 25934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:42:59.846632 25934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:42:59.846727 25934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:42:59.854260 25934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:42:59.854384 25934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:42:59.854499 25934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:42:59.864650 25934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:42:59.866436 25934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:42:59.868050 25934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:42:59.882674 25939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:59.882643 25940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:42:59.882611 25942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:42:59.883656 25934 server_base.cc:1034] running on GCE node
I20260619 04:42:59.884302 25934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:42:59.885269 25934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:42:59.886499 25934 hybrid_clock.cc:648] HybridClock initialized: now 1781844179886453 us; error 57 us; skew 500 ppm
I20260619 04:42:59.886822 25934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:42:59 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844179, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:42:59.890352 25934 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:42:59.891996 25934 webserver.cc:460] Webserver started at http://127.9.224.67:44079/ using document root <none> and password file <none>
I20260619 04:42:59.892796 25934 fs_manager.cc:359] Metadata directory not provided
I20260619 04:42:59.892948 25934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:42:59.893265 25934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:42:59.896330 25934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "cab570ea4c2a49b1963b9077cbddd6e6"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d74a331f9aab1381d3e1fa2f9f7256d6"
server_key_iv: "b27320d75a6c94d5db00b998f1db30be"
server_key_version: "encryptionkey@0"
I20260619 04:42:59.897107 25934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "cab570ea4c2a49b1963b9077cbddd6e6"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d74a331f9aab1381d3e1fa2f9f7256d6"
server_key_iv: "b27320d75a6c94d5db00b998f1db30be"
server_key_version: "encryptionkey@0"
I20260619 04:42:59.902787 25934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:42:59.906733 25949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:59.908433 25934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:42:59.908670 25934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "cab570ea4c2a49b1963b9077cbddd6e6"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d74a331f9aab1381d3e1fa2f9f7256d6"
server_key_iv: "b27320d75a6c94d5db00b998f1db30be"
server_key_version: "encryptionkey@0"
I20260619 04:42:59.908988 25934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:42:59.922529 25934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:42:59.927016 25934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:42:59.927341 25934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:42:59.928349 25934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:42:59.929719 25934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:42:59.929827 25934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:59.929975 25934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:42:59.930054 25934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:42:59.943164 25794 heartbeater.cc:503] Master 127.9.224.126:36203 was elected leader, sending a full tablet report...
I20260619 04:42:59.965584 25934 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33963
I20260619 04:42:59.965658 26061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33963 every 8 connection(s)
I20260619 04:42:59.966979 25934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:42:59.974614 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 25934
I20260619 04:42:59.974833 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:42:59.975502 10113 external_mini_cluster.cc:1428] Setting key fd601935b08139abf9cbd005b5587cfc
Jun 19 04:42:59 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844179, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:42:59.991945 26064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:59.969898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:46755 (local address 127.9.224.126:36203)
0619 04:42:59.970469 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0619 04:42:59.970473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:42:59.971439 (+ 966us) server_negotiation.cc:407] Connection header received
0619 04:42:59.973317 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:42:59.973321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:42:59.973407 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:42:59.973509 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:42:59.975740 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.976985 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.979191 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.979587 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.979690 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:59.984399 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:42:59.984409 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:42:59.984416 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:42:59.984480 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:42:59.988144 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:59.989195 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:59.989202 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:59.989211 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:59.989418 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:42:59.989943 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:42:59.989948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:42:59.989951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:42:59.990356 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:42:59.990530 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0619 04:42:59.991294 (+ 764us) server_negotiation.cc:299] Negotiation successful
0619 04:42:59.991533 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":304,"threads_started":1}
I20260619 04:42:59.992934 26065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:42:59.970565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:46755)
0619 04:42:59.971263 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0619 04:42:59.971307 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 04:42:59.973025 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:42:59.973790 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:42:59.973799 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:42:59.974564 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:42:59.975475 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:59.975506 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.977183 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.977189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:59.979030 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:42:59.979043 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:42:59.979800 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:42:59.979804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:42:59.980010 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:42:59.980803 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:42:59.980842 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:42:59.984070 (+ 3228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:42:59.988305 (+ 4235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:59.988316 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:59.988345 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:59.989006 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:59.989557 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:42:59.989561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:42:59.989564 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:42:59.989802 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:42:59.990493 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:42:59.990511 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:42:59.990900 (+ 389us) client_negotiation.cc:769] Sending connection context
0619 04:42:59.991168 (+ 268us) client_negotiation.cc:240] Negotiation successful
0619 04:42:59.991757 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":260,"threads_started":1}
I20260619 04:42:59.994382 26062 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36203
I20260619 04:42:59.994704 26062 heartbeater.cc:464] Registering TS with master...
I20260619 04:42:59.995429 26062 heartbeater.cc:511] Master 127.9.224.126:36203 requested a full tablet report, sending...
I20260619 04:42:59.996896 25605 ts_manager.cc:194] Registered new tserver with Master: cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963)
I20260619 04:42:59.997675 25605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:46755
I20260619 04:43:00.004182 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:43:00.024967 26064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.009588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36470 (local address 127.9.224.126:36203)
0619 04:43:00.009817 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.009823 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.010350 (+ 527us) server_negotiation.cc:407] Connection header received
0619 04:43:00.010498 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.010502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.010574 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.010676 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:00.012271 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.013241 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.015060 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.015562 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.015686 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.018584 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:00.018590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:00.018594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:00.018638 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:00.021545 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.022659 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.022664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.022667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.022828 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.023325 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.023329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.023331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.023744 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:00.023954 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.024463 (+ 509us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.024689 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:43:00.030102 25605 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36470:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:43:00.037900 25605 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:43:00.064553 26075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.052650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46449 (local address 127.0.0.1:58648)
0619 04:43:00.053661 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:00.053724 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:00.053968 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:00.057055 (+ 3087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:00.057060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:00.057100 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:00.057473 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.057484 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.059381 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.059386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.061583 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.061603 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.063439 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.063445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.063636 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.063728 (+ 92us) client_negotiation.cc:769] Sending connection context
0619 04:43:00.063836 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 04:43:00.064038 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":1,"thread_start_us":521,"threads_started":1}
I20260619 04:43:00.064955 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.053332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58648 (local address 127.9.224.66:46449)
0619 04:43:00.056347 (+ 3015us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.056362 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.056398 (+ 36us) server_negotiation.cc:407] Connection header received
0619 04:43:00.056516 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.056527 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.056823 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.057079 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:00.057694 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.059218 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.061751 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.063192 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.064226 (+ 1034us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.064413 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.064503 (+ 90us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.064689 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2836,"thread_start_us":2709,"threads_started":1}
I20260619 04:43:00.065182 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.053335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33963 (local address 127.0.0.1:46552)
0619 04:43:00.055632 (+ 2297us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:00.055652 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:00.055750 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:00.058352 (+ 2602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:00.058357 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:00.058382 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:00.058752 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.058761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.060680 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.060685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.062512 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.062524 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.064373 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.064379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.064572 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.064614 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 04:43:00.064709 (+ 95us) client_negotiation.cc:240] Negotiation successful
0619 04:43:00.064830 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2185,"thread_start_us":1750,"threads_started":1}
I20260619 04:43:00.065913 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.054347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.9.224.67:33963)
0619 04:43:00.057857 (+ 3510us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.057863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.057887 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:43:00.057965 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.057970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.058128 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.058357 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:00.058916 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.060527 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.062669 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.063885 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.064001 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.064231 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.065396 (+ 1165us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.065555 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3346,"thread_start_us":3164,"threads_started":1}
I20260619 04:43:00.065913 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.053872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33374 (local address 127.9.224.65:46087)
0619 04:43:00.054890 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.054903 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.055729 (+ 826us) server_negotiation.cc:407] Connection header received
0619 04:43:00.055856 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.055864 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.056136 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.056332 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:00.057129 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.058891 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.061498 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.063084 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.063243 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.063517 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.065234 (+ 1717us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.065561 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":597,"threads_started":1}
I20260619 04:43:00.066896 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.052790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:33374)
0619 04:43:00.055383 (+ 2593us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:00.055406 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:00.055563 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:00.056630 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:00.056636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:00.056660 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:00.056931 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.056938 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.059027 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.059034 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.061326 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.061339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.063303 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.063309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.063808 (+ 499us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.063849 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 04:43:00.063946 (+ 97us) client_negotiation.cc:240] Negotiation successful
0619 04:43:00.064084 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2438,"mutex_wait_us":2,"thread_start_us":2595,"threads_started":1}
I20260619 04:43:00.069113 25863 tablet_service.cc:1467] Processing CreateTablet for tablet 762cc90126f642f489bf33367b447b03 (DEFAULT_TABLE table=test-table [id=b7f70672efb64d52a13fc3dda7ae36a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:43:00.069523 25997 tablet_service.cc:1467] Processing CreateTablet for tablet 762cc90126f642f489bf33367b447b03 (DEFAULT_TABLE table=test-table [id=b7f70672efb64d52a13fc3dda7ae36a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:43:00.070604 25863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 762cc90126f642f489bf33367b447b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:43:00.071141 25997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 762cc90126f642f489bf33367b447b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:43:00.070636 25729 tablet_service.cc:1467] Processing CreateTablet for tablet 762cc90126f642f489bf33367b447b03 (DEFAULT_TABLE table=test-table [id=b7f70672efb64d52a13fc3dda7ae36a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:43:00.072060 25729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 762cc90126f642f489bf33367b447b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:43:00.083470 26081 tablet_bootstrap.cc:492] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Bootstrap starting.
I20260619 04:43:00.086774 26082 tablet_bootstrap.cc:492] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Bootstrap starting.
I20260619 04:43:00.087785 26083 tablet_bootstrap.cc:492] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Bootstrap starting.
I20260619 04:43:00.088522 26081 tablet_bootstrap.cc:654] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Neither blocks nor log segments found. Creating new log.
I20260619 04:43:00.089955 26081 log.cc:824] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:00.090610 26082 tablet_bootstrap.cc:654] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Neither blocks nor log segments found. Creating new log.
I20260619 04:43:00.091131 26083 tablet_bootstrap.cc:654] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Neither blocks nor log segments found. Creating new log.
I20260619 04:43:00.091840 26082 log.cc:824] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:00.092248 26083 log.cc:824] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:00.093441 26081 tablet_bootstrap.cc:492] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: No bootstrap required, opened a new log
I20260619 04:43:00.093786 26081 ts_tablet_manager.cc:1397] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260619 04:43:00.095201 26082 tablet_bootstrap.cc:492] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: No bootstrap required, opened a new log
I20260619 04:43:00.095487 26082 ts_tablet_manager.cc:1397] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 04:43:00.096015 26083 tablet_bootstrap.cc:492] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: No bootstrap required, opened a new log
I20260619 04:43:00.096269 26083 ts_tablet_manager.cc:1397] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.004s
I20260619 04:43:00.103643 26083 raft_consensus.cc:348] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.104061 26083 raft_consensus.cc:374] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:43:00.104182 26083 raft_consensus.cc:729] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51dfe74dbd3c4144bc0f1c3a0d7f892b, State: Initialized, Role: FOLLOWER
I20260619 04:43:00.105082 26083 consensus_queue.cc:260] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.104990 26081 raft_consensus.cc:348] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.105592 26081 raft_consensus.cc:374] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:43:00.105739 26081 raft_consensus.cc:729] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74aab8a009f14fec832d72a7932d4eae, State: Initialized, Role: FOLLOWER
I20260619 04:43:00.106451 26082 raft_consensus.cc:348] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.106715 26081 consensus_queue.cc:260] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.107031 26082 raft_consensus.cc:374] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:43:00.107177 26082 raft_consensus.cc:729] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab570ea4c2a49b1963b9077cbddd6e6, State: Initialized, Role: FOLLOWER
I20260619 04:43:00.107584 26083 ts_tablet_manager.cc:1428] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Time spent starting tablet: real 0.011s user 0.005s sys 0.007s
I20260619 04:43:00.108161 26082 consensus_queue.cc:260] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.109129 25928 heartbeater.cc:503] Master 127.9.224.126:36203 was elected leader, sending a full tablet report...
I20260619 04:43:00.110100 26081 ts_tablet_manager.cc:1428] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260619 04:43:00.111804 26082 ts_tablet_manager.cc:1428] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260619 04:43:00.111991 26062 heartbeater.cc:503] Master 127.9.224.126:36203 was elected leader, sending a full tablet report...
I20260619 04:43:00.152565 26089 raft_consensus.cc:482] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:00.152894 26089 raft_consensus.cc:504] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.154954 26089 leader_election.cc:288] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449), 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65:46087)
W20260619 04:43:00.159188 25795 tablet.cc:2369] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:43:00.161366 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.155401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:40555 (local address 127.9.224.66:46449)
0619 04:43:00.155678 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.155686 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.155710 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:43:00.155797 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.155805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.155910 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.156040 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:00.156747 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.157533 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.159527 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.160402 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.160558 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.160618 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.161048 (+ 430us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.161167 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260619 04:43:00.161497 26065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.155167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46449 (local address 127.9.224.67:40555)
0619 04:43:00.155388 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:00.155410 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:00.155551 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:00.156281 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:00.156286 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:00.156326 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:00.156573 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.156583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.157691 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.157699 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.159263 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.159276 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.160634 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.160640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.160832 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.160869 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 04:43:00.160972 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 04:43:00.161138 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":25}
I20260619 04:43:00.162792 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.155683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:46737 (local address 127.9.224.65:46087)
0619 04:43:00.156001 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.156009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.156676 (+ 667us) server_negotiation.cc:407] Connection header received
0619 04:43:00.156883 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.156887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.156969 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.157061 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:00.157641 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.158401 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.160578 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.161848 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.162029 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.162100 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.162411 (+ 311us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.162540 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 04:43:00.162663 25883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762cc90126f642f489bf33367b447b03" candidate_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74aab8a009f14fec832d72a7932d4eae" is_pre_election: true
I20260619 04:43:00.162902 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.155552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.9.224.67:46737)
0619 04:43:00.156559 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:00.156576 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:00.156725 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:00.157096 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:00.157100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:00.157123 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:00.157448 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.157456 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.158544 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.158555 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.160408 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:00.160420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.162036 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.162041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:00.162206 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.162272 (+ 66us) client_negotiation.cc:769] Sending connection context
0619 04:43:00.162374 (+ 102us) client_negotiation.cc:240] Negotiation successful
0619 04:43:00.162514 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":1,"thread_start_us":649,"threads_started":1}
I20260619 04:43:00.163226 25883 raft_consensus.cc:2454] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab570ea4c2a49b1963b9077cbddd6e6 in term 0.
I20260619 04:43:00.163834 25749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762cc90126f642f489bf33367b447b03" candidate_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" is_pre_election: true
I20260619 04:43:00.163976 25953 leader_election.cc:302] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74aab8a009f14fec832d72a7932d4eae, cab570ea4c2a49b1963b9077cbddd6e6; no voters:
I20260619 04:43:00.164377 26089 raft_consensus.cc:2781] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:43:00.164351 25749 raft_consensus.cc:2454] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab570ea4c2a49b1963b9077cbddd6e6 in term 0.
I20260619 04:43:00.164536 26089 raft_consensus.cc:482] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:43:00.164644 26089 raft_consensus.cc:3037] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:43:00.167114 26089 raft_consensus.cc:504] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.167709 26089 leader_election.cc:288] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449), 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65:46087)
I20260619 04:43:00.168265 25749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762cc90126f642f489bf33367b447b03" candidate_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b"
I20260619 04:43:00.168282 25883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762cc90126f642f489bf33367b447b03" candidate_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74aab8a009f14fec832d72a7932d4eae"
I20260619 04:43:00.168469 25749 raft_consensus.cc:3037] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:43:00.168577 25883 raft_consensus.cc:3037] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:43:00.170877 25749 raft_consensus.cc:2454] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab570ea4c2a49b1963b9077cbddd6e6 in term 1.
I20260619 04:43:00.170948 25883 raft_consensus.cc:2454] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab570ea4c2a49b1963b9077cbddd6e6 in term 1.
I20260619 04:43:00.171388 25952 leader_election.cc:302] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b, cab570ea4c2a49b1963b9077cbddd6e6; no voters:
I20260619 04:43:00.171790 26089 raft_consensus.cc:2781] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:43:00.172240 26089 raft_consensus.cc:686] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 LEADER]: Becoming Leader. State: Replica: cab570ea4c2a49b1963b9077cbddd6e6, State: Running, Role: LEADER
I20260619 04:43:00.172735 26089 consensus_queue.cc:237] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } }
I20260619 04:43:00.177345 25605 catalog_manager.cc:5495] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67). New cstate: current_term: 1 leader_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } health_report { overall_health: HEALTHY } } }
W20260619 04:43:00.184077 25929 tablet.cc:2369] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:43:00.218854 26063 tablet.cc:2369] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:43:00.224768 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.218299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46562 (local address 127.9.224.67:33963)
0619 04:43:00.218577 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.218584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.218700 (+ 116us) server_negotiation.cc:407] Connection header received
0619 04:43:00.218986 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.218997 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.219125 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.219312 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:43:00.219752 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.220571 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.222301 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.222770 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.222927 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.223558 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:43:00.224116 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:43:00.224294 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.224361 (+ 67us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.224455 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260619 04:43:00.234143 25749 raft_consensus.cc:1261] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Refusing update from remote peer cab570ea4c2a49b1963b9077cbddd6e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:43:00.234170 25883 raft_consensus.cc:1261] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Refusing update from remote peer cab570ea4c2a49b1963b9077cbddd6e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:43:00.235396 26091 consensus_queue.cc:1035] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:43:00.235776 26089 consensus_queue.cc:1035] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:43:00.268098 25605 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36470:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:43:00.268437 25605 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36470:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:43:00.273170 25605 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Sending DeleteTablet for 3 replicas of tablet 762cc90126f642f489bf33367b447b03
I20260619 04:43:00.274549 25863 tablet_service.cc:1514] Processing DeleteTablet for tablet 762cc90126f642f489bf33367b447b03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:43:00 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:58648
I20260619 04:43:00.274789 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25666
I20260619 04:43:00.274789 25997 tablet_service.cc:1514] Processing DeleteTablet for tablet 762cc90126f642f489bf33367b447b03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:43:00 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:46552
I20260619 04:43:00.275533 25729 tablet_service.cc:1514] Processing DeleteTablet for tablet 762cc90126f642f489bf33367b447b03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:43:00 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:33374
I20260619 04:43:00.275841 26104 tablet_replica.cc:330] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: stopping tablet replica
I20260619 04:43:00.276335 26104 raft_consensus.cc:2229] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:43:00.277362 26104 raft_consensus.cc:2258] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:43:00.279801 26103 tablet_replica.cc:330] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: stopping tablet replica
I20260619 04:43:00.280419 26103 raft_consensus.cc:2229] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:43:00.281068 26104 ts_tablet_manager.cc:1905] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:43:00.281122 26103 raft_consensus.cc:2258] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:43:00.283726 26103 ts_tablet_manager.cc:1905] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:43:00.289217 26104 ts_tablet_manager.cc:1918] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:43:00.289515 26104 log.cc:1196] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/762cc90126f642f489bf33367b447b03
I20260619 04:43:00.290120 26104 ts_tablet_manager.cc:1939] T 762cc90126f642f489bf33367b447b03 P cab570ea4c2a49b1963b9077cbddd6e6: Deleting consensus metadata
I20260619 04:43:00.292196 25589 catalog_manager.cc:4841] TS cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): tablet 762cc90126f642f489bf33367b447b03 (table test-table [id=b7f70672efb64d52a13fc3dda7ae36a9]) successfully deleted
I20260619 04:43:00.292791 26106 tablet_replica.cc:330] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: stopping tablet replica
I20260619 04:43:00.293308 26106 raft_consensus.cc:2229] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:43:00.293372 26103 ts_tablet_manager.cc:1918] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:43:00.293613 26103 log.cc:1196] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/762cc90126f642f489bf33367b447b03
I20260619 04:43:00.294063 26106 raft_consensus.cc:2258] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:43:00.294270 26103 ts_tablet_manager.cc:1939] T 762cc90126f642f489bf33367b447b03 P 74aab8a009f14fec832d72a7932d4eae: Deleting consensus metadata
I20260619 04:43:00.296418 25592 catalog_manager.cc:4841] TS 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): tablet 762cc90126f642f489bf33367b447b03 (table test-table [id=b7f70672efb64d52a13fc3dda7ae36a9]) successfully deleted
I20260619 04:43:00.296671 26106 ts_tablet_manager.cc:1905] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 04:43:00 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:43:00.304116 26106 ts_tablet_manager.cc:1918] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:43:00.304324 26106 log.cc:1196] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/762cc90126f642f489bf33367b447b03
I20260619 04:43:00.304885 26106 ts_tablet_manager.cc:1939] T 762cc90126f642f489bf33367b447b03 P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Deleting consensus metadata
I20260619 04:43:00.307129 25591 catalog_manager.cc:4841] TS 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65:46087): tablet 762cc90126f642f489bf33367b447b03 (table test-table [id=b7f70672efb64d52a13fc3dda7ae36a9]) successfully deleted
I20260619 04:43:00.307799 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.276191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33378 (local address 127.9.224.65:46087)
0619 04:43:00.276405 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.276414 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.278960 (+ 2546us) server_negotiation.cc:407] Connection header received
0619 04:43:00.279183 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.279192 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.279316 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.279441 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:00.281645 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.282864 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.290420 (+ 7556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.291161 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.291290 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.298345 (+ 7055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:00.298365 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:00.298385 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:00.298445 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:00.303414 (+ 4969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.304668 (+ 1254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.304680 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.304684 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.304897 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.305598 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.305603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.305606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.306114 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:00.306586 (+ 472us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.306970 (+ 384us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.307235 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:43:00.308622 25789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:00.399412 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25666
I20260619 04:43:00.418304 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25800
Jun 19 04:43:00 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:43:00.437668 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.419226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58658 (local address 127.9.224.66:46449)
0619 04:43:00.419405 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.419409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.419428 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:43:00.419659 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.419664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.419738 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.419834 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:00.421729 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.422643 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.424632 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.425068 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.425178 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.430897 (+ 5719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:00.430910 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:00.430925 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:00.431029 (+ 104us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:00.434303 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.435253 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.435262 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.435264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.435399 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.435833 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.435839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.435842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.436283 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:00.436596 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.436933 (+ 337us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.437184 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:43:00.438580 25923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:00.530859 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25800
I20260619 04:43:00.548678 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25934
Jun 19 04:43:00 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:43:00.568106 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:00.549523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.9.224.67:33963)
0619 04:43:00.549738 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:00.549744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:00.549767 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:43:00.549913 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:00.549921 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:00.550025 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:00.550167 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:00.551677 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.552922 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.554582 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:00.555293 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:00.555455 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:00.560931 (+ 5476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:00.560947 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:00.560963 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:00.561013 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:00.564568 (+ 3555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.565636 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.565644 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.565647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.565817 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:00.566332 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:00.566340 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:00.566346 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:00.566907 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:00.567228 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:00.567564 (+ 336us) server_negotiation.cc:299] Negotiation successful
0619 04:43:00.567748 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260619 04:43:00.568943 26057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:00.701813 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25934
I20260619 04:43:00.722918 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 25573
I20260619 04:43:00.724156 25635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:00.840647 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 25573
I20260619 04:43:20.862987 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36203
--webserver_interface=127.9.224.126
--webserver_port=40679
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:43:21.204285 26111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:21.204598 26111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:21.204775 26111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:21.212612 26111 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 04:43:21.212728 26111 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 04:43:21.212800 26111 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 04:43:21.212879 26111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:43:21.212981 26111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:21.213091 26111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:21.213179 26111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:43:21.213259 26111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:43:21.223894 26111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=40679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:21.225282 26111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:21.226750 26111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:21.251564 26117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:21.251598 26120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:21.251530 26118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:21.251554 26111 server_base.cc:1034] running on GCE node
I20260619 04:43:21.253048 26111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:21.254871 26111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:21.256165 26111 hybrid_clock.cc:648] HybridClock initialized: now 1781844201256073 us; error 73 us; skew 500 ppm
I20260619 04:43:21.256606 26111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:21 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844201, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:21.266187 26111 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:43:21.268253 26111 webserver.cc:460] Webserver started at http://127.9.224.126:40679/ using document root <none> and password file <none>
I20260619 04:43:21.269151 26111 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:21.269327 26111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:21.276003 26111 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 04:43:21.279450 26127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:21.280961 26111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:43:21.281175 26111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "c70ffb469e044de6bc18240b4d95a800"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "7394029d44beb34ca00a73ff1322b0ea"
server_key_iv: "a584e0c3f9940259a3135d477cb724ad"
server_key_version: "encryptionkey@0"
I20260619 04:43:21.282366 26111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:21.307755 26111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:21.312577 26111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:21.312915 26111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:21.333570 26111 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36203
I20260619 04:43:21.333604 26178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36203 every 8 connection(s)
I20260619 04:43:21.335283 26111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:43:21.339174 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26111
I20260619 04:43:21.340045 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:46087
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:36203
--webserver_port=40539
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:43:21.343302 26179 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:43:21.347048 26179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap starting.
I20260619 04:43:21.377584 26179 log.cc:824] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:21.394289 26179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:43:21.394973 26179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap complete.
I20260619 04:43:21.409642 26179 raft_consensus.cc:348] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:21.411368 26179 raft_consensus.cc:729] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70ffb469e044de6bc18240b4d95a800, State: Initialized, Role: FOLLOWER
I20260619 04:43:21.412387 26179 consensus_queue.cc:260] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:21.412786 26179 raft_consensus.cc:388] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:43:21.412956 26179 raft_consensus.cc:482] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:43:21.413198 26179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 1 FOLLOWER]: Advancing to term 2
I20260619 04:43:21.419581 26179 raft_consensus.cc:504] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:21.420352 26179 leader_election.cc:302] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c70ffb469e044de6bc18240b4d95a800; no voters:
I20260619 04:43:21.421022 26179 leader_election.cc:288] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 04:43:21.421202 26183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 04:43:21.422505 26183 raft_consensus.cc:686] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 LEADER]: Becoming Leader. State: Replica: c70ffb469e044de6bc18240b4d95a800, State: Running, Role: LEADER
I20260619 04:43:21.423230 26183 consensus_queue.cc:237] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:21.423411 26179 sys_catalog.cc:564] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:43:21.426164 26184 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c70ffb469e044de6bc18240b4d95a800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } } }
I20260619 04:43:21.426811 26184 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: This master's current role is: LEADER
I20260619 04:43:21.426033 26185 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c70ffb469e044de6bc18240b4d95a800. Latest consensus state: current_term: 2 leader_uuid: "c70ffb469e044de6bc18240b4d95a800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } } }
I20260619 04:43:21.427438 26185 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: This master's current role is: LEADER
I20260619 04:43:21.440017 26191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:43:21.449757 26191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:43:21.451491 26191 catalog_manager.cc:1259] Loaded cluster ID: 13468089f1434e7797f144e2e3a2dc9d
I20260619 04:43:21.451690 26191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:43:21.455909 26191 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:43:21.456723 26200 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 04:43:21.458094 26191 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Loaded TSK: 0
I20260619 04:43:21.486929 26191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Generated new TSK 1
I20260619 04:43:21.487366 26191 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 04:43:21.733848 26181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:21.734212 26181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:21.734440 26181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:21.742631 26181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:21.742797 26181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:21.743031 26181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:43:21.753795 26181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:46087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=40539
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:21.755586 26181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:21.757341 26181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:21.779397 26207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:21.779948 26209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:21.781352 26206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:21.783008 26181 server_base.cc:1034] running on GCE node
I20260619 04:43:21.784927 26181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:21.786438 26181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:21.787818 26181 hybrid_clock.cc:648] HybridClock initialized: now 1781844201787731 us; error 72 us; skew 500 ppm
I20260619 04:43:21.788305 26181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:21 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844201, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:21.793426 26181 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:43:21.795837 26181 webserver.cc:460] Webserver started at http://127.9.224.65:40539/ using document root <none> and password file <none>
I20260619 04:43:21.796619 26181 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:21.796792 26181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:21.803900 26181 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:43:21.807798 26216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:21.809967 26181 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260619 04:43:21.810189 26181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "2f0d5ff148068d5de447e1ebd0b2bd6c"
server_key_iv: "c6f58f396e8f791355f3a4c171b8efa1"
server_key_version: "encryptionkey@0"
I20260619 04:43:21.811939 26181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:21.828504 26181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:21.833374 26181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:21.833765 26181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:21.835127 26181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:43:21.836769 26181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:43:21.836906 26181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:21.837054 26181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:43:21.837157 26181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:21.875113 26181 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:46087
I20260619 04:43:21.875167 26328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:46087 every 8 connection(s)
I20260619 04:43:21.876670 26181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:43:21.883150 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26181
I20260619 04:43:21.883965 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:46449
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:36203
--webserver_port=38777
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:43:21 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844201, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:43:21.905246 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:21.880373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:60829)
0619 04:43:21.881149 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:21.881195 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:21.883122 (+ 1927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:21.884982 (+ 1860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:21.884991 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:21.885685 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:43:21.886505 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:21.886531 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:21.888399 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:21.888404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:21.889786 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:21.889803 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:21.891286 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:21.891298 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:21.891686 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:21.892466 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:43:21.892491 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:43:21.895051 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:43:21.900380 (+ 5329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:21.900388 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:21.900400 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:21.900890 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:21.901511 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:21.901515 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:21.901517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:21.901744 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:21.902942 (+ 1198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:43:21.902949 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:43:21.903326 (+ 377us) client_negotiation.cc:769] Sending connection context
0619 04:43:21.903706 (+ 380us) client_negotiation.cc:240] Negotiation successful
0619 04:43:21.904149 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":329,"threads_started":1}
I20260619 04:43:21.906145 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:21.879911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:60829 (local address 127.9.224.126:36203)
0619 04:43:21.880554 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:21.880571 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:21.881389 (+ 818us) server_negotiation.cc:407] Connection header received
0619 04:43:21.883778 (+ 2389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:21.883799 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:21.884377 (+ 578us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:21.884823 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:21.886812 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:21.888186 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:21.889976 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:21.890875 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:21.891108 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:21.895428 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:21.895443 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:21.895468 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:21.895529 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:21.900184 (+ 4655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:21.901084 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:21.901106 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:21.901117 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:21.901362 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:21.901902 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:21.901910 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:21.901917 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:21.902759 (+ 842us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:21.902990 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:21.904044 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0619 04:43:21.904594 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":289,"threads_started":1}
I20260619 04:43:21.909417 26329 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36203
I20260619 04:43:21.909826 26329 heartbeater.cc:464] Registering TS with master...
I20260619 04:43:21.910966 26329 heartbeater.cc:511] Master 127.9.224.126:36203 requested a full tablet report, sending...
I20260619 04:43:21.913759 26144 ts_manager.cc:194] Registered new tserver with Master: 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65:46087)
I20260619 04:43:21.915457 26144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:60829
W20260619 04:43:22.240128 26333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:22.240445 26333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:22.240609 26333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:22.248387 26333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:22.248512 26333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:22.248716 26333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:43:22.259133 26333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:46449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=38777
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:22.260540 26333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:22.262058 26333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:22.276183 26338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:22.276104 26339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:22.276161 26341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:22.277536 26333 server_base.cc:1034] running on GCE node
I20260619 04:43:22.278354 26333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:22.279520 26333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:22.280771 26333 hybrid_clock.cc:648] HybridClock initialized: now 1781844202280710 us; error 46 us; skew 500 ppm
I20260619 04:43:22.281147 26333 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:22 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844202, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:22.284600 26333 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:43:22.286408 26333 webserver.cc:460] Webserver started at http://127.9.224.66:38777/ using document root <none> and password file <none>
I20260619 04:43:22.287158 26333 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:22.287341 26333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:22.293234 26333 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260619 04:43:22.296360 26348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:22.298123 26333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:43:22.298388 26333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "74aab8a009f14fec832d72a7932d4eae"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d709c33fb810e165faa7acb520607c5a"
server_key_iv: "e32d63eb8d5296c90f594ef8a08406c2"
server_key_version: "encryptionkey@0"
I20260619 04:43:22.299507 26333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:22.321549 26333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:22.326128 26333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:22.326458 26333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:22.327518 26333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:43:22.328955 26333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:43:22.329087 26333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:22.329221 26333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:43:22.329313 26333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:22.366858 26333 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:46449
I20260619 04:43:22.366947 26460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:46449 every 8 connection(s)
I20260619 04:43:22.368295 26333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:43:22.373310 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26333
I20260619 04:43:22.373935 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:33963
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:36203
--webserver_port=44079
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 04:43:22 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844202, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:43:22.392575 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.371157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:35081 (local address 127.9.224.126:36203)
0619 04:43:22.371394 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.371401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.372507 (+ 1106us) server_negotiation.cc:407] Connection header received
0619 04:43:22.374860 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.374869 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.375015 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.375135 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:22.376871 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.378003 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.380643 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.381204 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.381325 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.385523 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:22.385529 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:22.385532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:22.385567 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:22.388435 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.389591 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.389596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.389598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.389726 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.390373 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.390377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.390379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.390706 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:22.390857 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.392063 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.392313 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260619 04:43:22.394200 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.371558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:35081)
0619 04:43:22.372324 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:22.372374 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:22.374534 (+ 2160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:22.375408 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:22.375418 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:22.376054 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:43:22.376674 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.376694 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.378215 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.378223 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.380445 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.380463 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.381477 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.381486 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.381758 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.382504 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:43:22.382532 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:43:22.385237 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:43:22.388594 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:22.388608 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:22.388641 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:22.389433 (+ 792us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:22.389847 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:22.389856 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:22.389863 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:22.390211 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:22.390851 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:43:22.390862 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:43:22.391412 (+ 550us) client_negotiation.cc:769] Sending connection context
0619 04:43:22.391785 (+ 373us) client_negotiation.cc:240] Negotiation successful
0619 04:43:22.392464 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":297,"threads_started":1}
I20260619 04:43:22.396072 26461 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36203
I20260619 04:43:22.396464 26461 heartbeater.cc:464] Registering TS with master...
I20260619 04:43:22.397228 26461 heartbeater.cc:511] Master 127.9.224.126:36203 requested a full tablet report, sending...
I20260619 04:43:22.398881 26144 ts_manager.cc:194] Registered new tserver with Master: 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
I20260619 04:43:22.399735 26144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:35081
W20260619 04:43:22.728171 26464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:22.728519 26464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:22.728696 26464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:22.736596 26464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:22.736773 26464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:22.736994 26464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:43:22.750643 26464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:33963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=44079
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:22.752095 26464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:22.753515 26464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:22.767366 26469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:22.767442 26472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:22.767468 26470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:22.768389 26464 server_base.cc:1034] running on GCE node
I20260619 04:43:22.769102 26464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:22.770161 26464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:22.771446 26464 hybrid_clock.cc:648] HybridClock initialized: now 1781844202771389 us; error 44 us; skew 500 ppm
I20260619 04:43:22.771761 26464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:22 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844202, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:22.775218 26464 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:43:22.776842 26464 webserver.cc:460] Webserver started at http://127.9.224.67:44079/ using document root <none> and password file <none>
I20260619 04:43:22.777588 26464 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:22.777768 26464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:22.783665 26464 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260619 04:43:22.786850 26479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:22.788595 26464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:43:22.788818 26464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "cab570ea4c2a49b1963b9077cbddd6e6"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d74a331f9aab1381d3e1fa2f9f7256d6"
server_key_iv: "b27320d75a6c94d5db00b998f1db30be"
server_key_version: "encryptionkey@0"
I20260619 04:43:22.789880 26464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:22.806676 26464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:22.811787 26464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:22.812099 26464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:22.813123 26464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:43:22.814783 26464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:43:22.814901 26464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:22.815030 26464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:43:22.815130 26464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:22.850934 26464 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33963
I20260619 04:43:22.851008 26591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33963 every 8 connection(s)
I20260619 04:43:22.852519 26464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:43:22.854882 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26464
Jun 19 04:43:22 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844202, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:43:22.872102 26595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.856247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39990 (local address 127.9.224.126:36203)
0619 04:43:22.856736 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.856748 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.856764 (+ 16us) server_negotiation.cc:407] Connection header received
0619 04:43:22.856816 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.856820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.856885 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.857004 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:22.858767 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.859594 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.861166 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.861857 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.861997 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.865386 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:22.865395 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:22.865401 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:22.865459 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:22.868835 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.869786 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.869795 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.869801 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.869963 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.870499 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.870506 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.870509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.870792 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:22.871076 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.871428 (+ 352us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.871662 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":371,"thread_start_us":372,"threads_started":1}
I20260619 04:43:22.878072 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.855432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:43469 (local address 127.9.224.126:36203)
0619 04:43:22.855607 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.855612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.859069 (+ 3457us) server_negotiation.cc:407] Connection header received
0619 04:43:22.860967 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.860972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.861055 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.861157 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:22.863219 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.864410 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.866756 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.867236 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.867382 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.871538 (+ 4156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:22.871543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:22.871547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:22.871576 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:22.874992 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.875768 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.875773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.875777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.875903 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.876349 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.876355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.876358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.876632 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:22.876782 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.877459 (+ 677us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.877696 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 04:43:22.879282 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.856111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:43469)
0619 04:43:22.858894 (+ 2783us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:22.858951 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:22.860701 (+ 1750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:22.861467 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:22.861480 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:22.862347 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:43:22.863045 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.863063 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.864596 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.864601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.866575 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.866598 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.867520 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.867528 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.867767 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.868414 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:43:22.868438 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:43:22.871312 (+ 2874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:43:22.875139 (+ 3827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:22.875150 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:22.875168 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:22.875610 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:22.876014 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:22.876019 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:22.876023 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:22.876232 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:22.876756 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:43:22.876764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:43:22.877107 (+ 343us) client_negotiation.cc:769] Sending connection context
0619 04:43:22.877366 (+ 259us) client_negotiation.cc:240] Negotiation successful
0619 04:43:22.877957 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2473,"thread_start_us":2264,"threads_started":1}
I20260619 04:43:22.880829 26592 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36203
I20260619 04:43:22.881141 26592 heartbeater.cc:464] Registering TS with master...
I20260619 04:43:22.881933 26592 heartbeater.cc:511] Master 127.9.224.126:36203 requested a full tablet report, sending...
I20260619 04:43:22.883577 26144 ts_manager.cc:194] Registered new tserver with Master: cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963)
I20260619 04:43:22.884475 26144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:43469
I20260619 04:43:22.892064 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:43:22.899403 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.893136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.9.224.126:36203)
0619 04:43:22.893502 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.893506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.893749 (+ 243us) server_negotiation.cc:407] Connection header received
0619 04:43:22.894002 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.894012 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.894173 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.894407 (+ 234us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:43:22.894875 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.895779 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.897355 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.897825 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.897947 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.898635 (+ 688us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:43:22.898855 (+ 220us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0619 04:43:22.899195 (+ 340us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39994: token expired
Metrics: {"server-negotiator.queue_time_us":235}
W20260619 04:43:22.899576 26331 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39994: token expired
W20260619 04:43:22.900163 26067 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.224.126:36203)
I20260619 04:43:22.915674 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.900673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40008 (local address 127.9.224.126:36203)
0619 04:43:22.900831 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.900835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.900896 (+ 61us) server_negotiation.cc:407] Connection header received
0619 04:43:22.901062 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.901067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.901160 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.901256 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:22.902962 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.903765 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.905459 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.905984 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.906084 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.909423 (+ 3339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:22.909429 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:22.909433 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:22.909472 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:22.912629 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.913422 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.913427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.913429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.913557 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:22.913975 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:22.913979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:22.913982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:22.914516 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:22.914739 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.915140 (+ 401us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.915400 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:43:22.919718 26329 heartbeater.cc:503] Master 127.9.224.126:36203 was elected leader, sending a full tablet report...
I20260619 04:43:22.919545 26144 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:43:22.927410 26144 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:43:22.950758 26604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.939739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.9.224.65:46087)
0619 04:43:22.941206 (+ 1467us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.941217 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.941248 (+ 31us) server_negotiation.cc:407] Connection header received
0619 04:43:22.941359 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.941367 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.941622 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.941800 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:22.943294 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.945057 (+ 1763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.947832 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.949196 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.949333 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.949585 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.950112 (+ 527us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.950335 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1270,"thread_start_us":1134,"threads_started":1}
I20260619 04:43:22.951172 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.939371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:44042)
0619 04:43:22.940871 (+ 1500us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:22.940892 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:22.941001 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:22.942090 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:22.942098 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:22.942139 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:22.943005 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.943019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.945228 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.945236 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.947658 (+ 2422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.947675 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.949628 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.949635 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.949827 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.949888 (+ 61us) client_negotiation.cc:769] Sending connection context
0619 04:43:22.950040 (+ 152us) client_negotiation.cc:240] Negotiation successful
0619 04:43:22.950367 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1335,"mutex_wait_us":375,"spinlock_wait_cycles":1280,"thread_start_us":3760,"threads_started":1}
I20260619 04:43:22.951642 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.941366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.9.224.66:46449)
0619 04:43:22.943650 (+ 2284us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.943660 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.943701 (+ 41us) server_negotiation.cc:407] Connection header received
0619 04:43:22.943782 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.943787 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.943946 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.944125 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:22.944640 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.946232 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.948840 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.950190 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.950343 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.950554 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.951157 (+ 603us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.951341 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2146,"thread_start_us":1416,"threads_started":1}
I20260619 04:43:22.951676 26603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.940064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46449 (local address 127.0.0.1:35582)
0619 04:43:22.943481 (+ 3417us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:22.943499 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:22.943604 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:22.944126 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:22.944132 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:22.944156 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:22.944483 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.944498 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.946407 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.946413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.948675 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.948690 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.950750 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.950757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.950965 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.950995 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 04:43:22.951088 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 04:43:22.951244 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3292,"mutex_wait_us":5,"thread_start_us":1220,"threads_started":1}
I20260619 04:43:22.951807 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.939366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33963 (local address 127.0.0.1:59556)
0619 04:43:22.940304 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:22.940349 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:22.940549 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:22.942090 (+ 1541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:22.942098 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:22.942146 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:22.943005 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.943019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.945261 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.945269 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.948197 (+ 2928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:22.948212 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.950900 (+ 2688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.950907 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:22.951107 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.951140 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 04:43:22.951244 (+ 104us) client_negotiation.cc:240] Negotiation successful
0619 04:43:22.951379 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":205,"spinlock_wait_cycles":5632,"thread_start_us":443,"threads_started":1}
I20260619 04:43:22.952842 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:22.940746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59556 (local address 127.9.224.67:33963)
0619 04:43:22.941487 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:22.941494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:22.941521 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:43:22.941608 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:22.941614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:22.941847 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:22.943225 (+ 1378us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:22.943512 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.945122 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.948575 (+ 3453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:22.950567 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:22.952146 (+ 1579us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:22.952332 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:22.952393 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 04:43:22.952509 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":719,"threads_started":1}
I20260619 04:43:22.955806 26396 tablet_service.cc:1467] Processing CreateTablet for tablet b03c772044fa44129f3cc7492f9819fc (DEFAULT_TABLE table=test-table [id=185a3194c7d24acb8750834e540c9265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:43:22.955813 26264 tablet_service.cc:1467] Processing CreateTablet for tablet b03c772044fa44129f3cc7492f9819fc (DEFAULT_TABLE table=test-table [id=185a3194c7d24acb8750834e540c9265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:43:22.956288 26527 tablet_service.cc:1467] Processing CreateTablet for tablet b03c772044fa44129f3cc7492f9819fc (DEFAULT_TABLE table=test-table [id=185a3194c7d24acb8750834e540c9265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:43:22.957418 26264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b03c772044fa44129f3cc7492f9819fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:43:22.957415 26396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b03c772044fa44129f3cc7492f9819fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:43:22.957571 26527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b03c772044fa44129f3cc7492f9819fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:43:22.971275 26608 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Bootstrap starting.
I20260619 04:43:22.973939 26609 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Bootstrap starting.
I20260619 04:43:22.975814 26610 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Bootstrap starting.
I20260619 04:43:22.977053 26608 tablet_bootstrap.cc:654] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Neither blocks nor log segments found. Creating new log.
I20260619 04:43:22.977735 26609 tablet_bootstrap.cc:654] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Neither blocks nor log segments found. Creating new log.
I20260619 04:43:22.978482 26608 log.cc:824] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:22.979033 26609 log.cc:824] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:22.979415 26610 tablet_bootstrap.cc:654] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Neither blocks nor log segments found. Creating new log.
I20260619 04:43:22.980597 26610 log.cc:824] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:22.982023 26608 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: No bootstrap required, opened a new log
I20260619 04:43:22.982069 26609 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: No bootstrap required, opened a new log
I20260619 04:43:22.982378 26608 ts_tablet_manager.cc:1397] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260619 04:43:22.982455 26609 ts_tablet_manager.cc:1397] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260619 04:43:22.983791 26610 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: No bootstrap required, opened a new log
I20260619 04:43:22.984078 26610 ts_tablet_manager.cc:1397] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260619 04:43:22.990788 26608 raft_consensus.cc:348] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:22.991219 26608 raft_consensus.cc:374] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:43:22.991370 26608 raft_consensus.cc:729] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab570ea4c2a49b1963b9077cbddd6e6, State: Initialized, Role: FOLLOWER
I20260619 04:43:22.992029 26608 consensus_queue.cc:260] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:22.993214 26592 heartbeater.cc:503] Master 127.9.224.126:36203 was elected leader, sending a full tablet report...
I20260619 04:43:22.993359 26609 raft_consensus.cc:348] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:22.993808 26609 raft_consensus.cc:374] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:43:22.993899 26609 raft_consensus.cc:729] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74aab8a009f14fec832d72a7932d4eae, State: Initialized, Role: FOLLOWER
I20260619 04:43:22.994002 26608 ts_tablet_manager.cc:1428] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260619 04:43:22.994571 26609 consensus_queue.cc:260] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:22.995076 26610 raft_consensus.cc:348] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:22.995728 26610 raft_consensus.cc:374] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:43:22.995908 26610 raft_consensus.cc:729] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51dfe74dbd3c4144bc0f1c3a0d7f892b, State: Initialized, Role: FOLLOWER
I20260619 04:43:22.996661 26461 heartbeater.cc:503] Master 127.9.224.126:36203 was elected leader, sending a full tablet report...
I20260619 04:43:22.997440 26609 ts_tablet_manager.cc:1428] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260619 04:43:22.997805 26610 consensus_queue.cc:260] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:22.999987 26610 ts_tablet_manager.cc:1428] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Time spent starting tablet: real 0.016s user 0.005s sys 0.010s
I20260619 04:43:23.095337 26616 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:23.095719 26616 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:23.097608 26616 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
W20260619 04:43:23.104245 26593 tablet.cc:2369] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:43:23.105166 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.098308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:34601 (local address 127.9.224.66:46449)
0619 04:43:23.098505 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:23.098514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:23.099289 (+ 775us) server_negotiation.cc:407] Connection header received
0619 04:43:23.099502 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:23.099511 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:23.099583 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:23.099692 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:23.100373 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.101068 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.103027 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.103996 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.104184 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.104264 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:23.104738 (+ 474us) server_negotiation.cc:299] Negotiation successful
0619 04:43:23.104887 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 04:43:23.105201 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.097960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:41165 (local address 127.9.224.67:33963)
0619 04:43:23.098182 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:23.098190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:23.099037 (+ 847us) server_negotiation.cc:407] Connection header received
0619 04:43:23.099552 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:23.099558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:23.099632 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:23.099720 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:43:23.100547 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.101247 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.103118 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.104087 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.104262 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.104351 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:23.104792 (+ 441us) server_negotiation.cc:299] Negotiation successful
0619 04:43:23.104946 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:43:23.106117 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.098090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46449 (local address 127.9.224.65:34601)
0619 04:43:23.099121 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.099139 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:23.099341 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:23.099712 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:23.099716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:23.099740 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:23.100205 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:23.100215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.101213 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.101220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:23.102867 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:23.102883 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.104255 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.104264 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:23.104500 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.104559 (+ 59us) client_negotiation.cc:769] Sending connection context
0619 04:43:23.105365 (+ 806us) client_negotiation.cc:240] Negotiation successful
0619 04:43:23.105571 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":67,"thread_start_us":726,"threads_started":1}
I20260619 04:43:23.106117 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.098069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33963 (local address 127.9.224.65:41165)
0619 04:43:23.098891 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.098921 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:23.099385 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:23.099911 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:23.099914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:23.099937 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:43:23.100402 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:23.100411 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.101388 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.101394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:23.102963 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:23.102975 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.104430 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.104436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:23.104614 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.104653 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 04:43:23.105369 (+ 716us) client_negotiation.cc:240] Negotiation successful
0619 04:43:23.105571 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"mutex_wait_us":52,"thread_start_us":452,"threads_started":1}
I20260619 04:43:23.107270 26547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b03c772044fa44129f3cc7492f9819fc" candidate_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" is_pre_election: true
I20260619 04:43:23.107604 26416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b03c772044fa44129f3cc7492f9819fc" candidate_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74aab8a009f14fec832d72a7932d4eae" is_pre_election: true
I20260619 04:43:23.107926 26547 raft_consensus.cc:2454] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51dfe74dbd3c4144bc0f1c3a0d7f892b in term 0.
I20260619 04:43:23.108093 26416 raft_consensus.cc:2454] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51dfe74dbd3c4144bc0f1c3a0d7f892b in term 0.
I20260619 04:43:23.108716 26217 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b, cab570ea4c2a49b1963b9077cbddd6e6; no voters:
I20260619 04:43:23.109143 26616 raft_consensus.cc:2781] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:43:23.109274 26616 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:43:23.109400 26616 raft_consensus.cc:3037] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:43:23.111696 26616 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:23.112375 26616 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 1 election: Requested vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
I20260619 04:43:23.112946 26547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b03c772044fa44129f3cc7492f9819fc" candidate_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab570ea4c2a49b1963b9077cbddd6e6"
I20260619 04:43:23.112979 26416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b03c772044fa44129f3cc7492f9819fc" candidate_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74aab8a009f14fec832d72a7932d4eae"
I20260619 04:43:23.113179 26547 raft_consensus.cc:3037] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:43:23.113234 26416 raft_consensus.cc:3037] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:43:23.116657 26416 raft_consensus.cc:2454] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51dfe74dbd3c4144bc0f1c3a0d7f892b in term 1.
I20260619 04:43:23.116695 26547 raft_consensus.cc:2454] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51dfe74dbd3c4144bc0f1c3a0d7f892b in term 1.
I20260619 04:43:23.117226 26217 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b, cab570ea4c2a49b1963b9077cbddd6e6; no voters:
I20260619 04:43:23.117640 26616 raft_consensus.cc:2781] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:43:23.118314 26616 raft_consensus.cc:686] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 LEADER]: Becoming Leader. State: Replica: 51dfe74dbd3c4144bc0f1c3a0d7f892b, State: Running, Role: LEADER
I20260619 04:43:23.118906 26616 consensus_queue.cc:237] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
W20260619 04:43:23.120255 26462 tablet.cc:2369] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:43:23.123869 26143 catalog_manager.cc:5495] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b reported cstate change: term changed from 0 to 1, leader changed from <none> to 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65). New cstate: current_term: 1 leader_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } health_report { overall_health: UNKNOWN } } }
W20260619 04:43:23.129227 26330 tablet.cc:2369] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:43:23.150895 26604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.144788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44048 (local address 127.9.224.65:46087)
0619 04:43:23.145016 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:23.145024 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:23.145128 (+ 104us) server_negotiation.cc:407] Connection header received
0619 04:43:23.145408 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:23.145412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:23.145495 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:23.145664 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:43:23.146092 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.146999 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.148521 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.149001 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.149149 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.149676 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:43:23.150213 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:43:23.150458 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:23.150514 (+ 56us) server_negotiation.cc:299] Negotiation successful
0619 04:43:23.150603 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:43:23.159855 26416 raft_consensus.cc:1261] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Refusing update from remote peer 51dfe74dbd3c4144bc0f1c3a0d7f892b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:43:23.159854 26547 raft_consensus.cc:1261] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Refusing update from remote peer 51dfe74dbd3c4144bc0f1c3a0d7f892b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:43:23.161064 26616 consensus_queue.cc:1035] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [LEADER]: Connected to new peer: Peer: permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:43:23.161382 26619 consensus_queue.cc:1035] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:43:23.174921 26623 mvcc.cc:205] Tried to move back new op lower bound from 7298433856131067904 to 7298433855979311104. Current Snapshot: MvccSnapshot[applied={T|T < 7298433856131067904}]
I20260619 04:43:23.178869 26624 mvcc.cc:205] Tried to move back new op lower bound from 7298433856131067904 to 7298433855979311104. Current Snapshot: MvccSnapshot[applied={T|T < 7298433856131067904 or (T in {7298433856131067904})}]
I20260619 04:43:23.187045 26144 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:43:23.187345 26144 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:43:23.191053 26144 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Sending DeleteTablet for 3 replicas of tablet b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:23.192278 26264 tablet_service.cc:1514] Processing DeleteTablet for tablet b03c772044fa44129f3cc7492f9819fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:43:23 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:44042
I20260619 04:43:23.192307 26527 tablet_service.cc:1514] Processing DeleteTablet for tablet b03c772044fa44129f3cc7492f9819fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:43:23 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:59556
I20260619 04:43:23.192701 26396 tablet_service.cc:1514] Processing DeleteTablet for tablet b03c772044fa44129f3cc7492f9819fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:43:23 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:35582
I20260619 04:43:23.193922 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 26181
I20260619 04:43:23.205026 26632 tablet_replica.cc:330] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: stopping tablet replica
I20260619 04:43:23.207120 26632 raft_consensus.cc:2229] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:43:23.208091 26632 raft_consensus.cc:2258] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:43:23.210911 26631 tablet_replica.cc:330] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: stopping tablet replica
I20260619 04:43:23.211570 26631 raft_consensus.cc:2229] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:43:23.212288 26631 raft_consensus.cc:2258] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:43:23.215514 26631 ts_tablet_manager.cc:1905] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:43:23.218380 26632 ts_tablet_manager.cc:1905] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:43:23.221312 26604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.195761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44064 (local address 127.9.224.65:46087)
0619 04:43:23.195986 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:23.195994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:23.196027 (+ 33us) server_negotiation.cc:407] Connection header received
0619 04:43:23.196101 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:23.196108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:23.196221 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:23.196341 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:23.199109 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.200867 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.206057 (+ 5190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.206859 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.207124 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.211118 (+ 3994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:23.211143 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:23.211169 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:23.211239 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:23.216146 (+ 4907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:23.217419 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:23.217435 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:23.217441 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:23.217644 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:23.218198 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:23.218204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:23.218208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:23.218863 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:23.219187 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:23.220623 (+ 1436us) server_negotiation.cc:299] Negotiation successful
0619 04:43:23.220902 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 04:43:23.221452 26633 tablet_replica.cc:330] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: stopping tablet replica
I20260619 04:43:23.222524 26324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:23.222548 26633 raft_consensus.cc:2229] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:43:23.223101 26633 raft_consensus.cc:2258] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:43:23.223503 26631 ts_tablet_manager.cc:1918] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:43:23.223690 26631 log.cc:1196] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:23.224555 26631 ts_tablet_manager.cc:1939] T b03c772044fa44129f3cc7492f9819fc P cab570ea4c2a49b1963b9077cbddd6e6: Deleting consensus metadata
I20260619 04:43:23.225725 26633 ts_tablet_manager.cc:1905] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:43:23.227366 26128 catalog_manager.cc:4841] TS cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): tablet b03c772044fa44129f3cc7492f9819fc (table test-table [id=185a3194c7d24acb8750834e540c9265]) successfully deleted
I20260619 04:43:23.233695 26633 ts_tablet_manager.cc:1918] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:43:23.233916 26633 log.cc:1196] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:23.234549 26633 ts_tablet_manager.cc:1939] T b03c772044fa44129f3cc7492f9819fc P 74aab8a009f14fec832d72a7932d4eae: Deleting consensus metadata
I20260619 04:43:23.236824 26131 catalog_manager.cc:4841] TS 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): tablet b03c772044fa44129f3cc7492f9819fc (table test-table [id=185a3194c7d24acb8750834e540c9265]) successfully deleted
I20260619 04:43:23.329329 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 26181
W20260619 04:43:23.347843 26130 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.224.65:46087 (error 108)
I20260619 04:43:23.348044 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 26333
I20260619 04:43:23.349814 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.349417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:44070)
0619 04:43:23.349586 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.349688 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260619 04:43:23.350035 26130 catalog_manager.cc:4584] TS 51dfe74dbd3c4144bc0f1c3a0d7f892b (127.9.224.65:46087): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b03c772044fa44129f3cc7492f9819fc: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
I20260619 04:43:23.366824 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.348897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35588 (local address 127.9.224.66:46449)
0619 04:43:23.349087 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:23.349093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:23.349116 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:43:23.349318 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:23.349323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:23.349420 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:23.349539 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:23.351117 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.351862 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.353170 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.353572 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.353702 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.360607 (+ 6905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:23.360623 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:23.360638 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:23.360674 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:23.363733 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:23.364504 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:23.364513 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:23.364515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:23.364635 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:23.365028 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:23.365032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:23.365034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:23.365409 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:23.365732 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:23.366059 (+ 327us) server_negotiation.cc:299] Negotiation successful
0619 04:43:23.366523 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:43:23.367522 26456 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:23.403939 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.403372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60876)
0619 04:43:23.403620 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.403755 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260619 04:43:23.405023 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.404622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60878)
0619 04:43:23.404783 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.404883 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260619 04:43:23.459420 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 26333
I20260619 04:43:23.465427 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.464960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60888)
0619 04:43:23.465178 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.465265 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 04:43:23.466503 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.466115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60894)
0619 04:43:23.466312 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.466384 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260619 04:43:23.479423 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 26464
I20260619 04:43:23.493938 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.480291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.9.224.67:33963)
0619 04:43:23.480477 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:23.480482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:23.480500 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:43:23.480589 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:23.480593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:23.480657 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:23.480767 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:23.482101 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.482905 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.484200 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:23.484599 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:23.484699 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:23.487784 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:23.487801 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:23.487817 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:23.487855 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:23.491086 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:23.491810 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:23.491819 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:23.491823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:23.491982 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:23.492344 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:23.492348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:23.492350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:23.492722 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:23.492947 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:23.493303 (+ 356us) server_negotiation.cc:299] Negotiation successful
0619 04:43:23.493491 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:43:23.494736 26587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:23.547770 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.547244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60902)
0619 04:43:23.547469 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.547599 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260619 04:43:23.548866 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.548459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60906)
0619 04:43:23.548664 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.548734 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260619 04:43:23.595115 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 26464
I20260619 04:43:23.612176 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 26111
I20260619 04:43:23.613605 26174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:43:23.733364 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 26111
I20260619 04:43:23.733454 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:23.732650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:46087 (local address 127.0.0.1:60910)
0619 04:43:23.733013 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:23.733099 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260619 04:43:43.757567 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36203
--webserver_interface=127.9.224.126
--webserver_port=40679
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:43:44.103708 26639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:44.104005 26639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:44.104180 26639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:44.111673 26639 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 04:43:44.111775 26639 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 04:43:44.111847 26639 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 04:43:44.111922 26639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:43:44.112005 26639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:44.112115 26639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:44.112195 26639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:43:44.112272 26639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:43:44.122545 26639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=40679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:44.123926 26639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:44.125388 26639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:44.137940 26647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:44.137988 26645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:44.138265 26644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:44.138861 26639 server_base.cc:1034] running on GCE node
I20260619 04:43:44.139699 26639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:44.141240 26639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:44.142508 26639 hybrid_clock.cc:648] HybridClock initialized: now 1781844224142421 us; error 57 us; skew 500 ppm
I20260619 04:43:44.142870 26639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:44 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844224, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:44.146085 26639 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:43:44.147748 26639 webserver.cc:460] Webserver started at http://127.9.224.126:40679/ using document root <none> and password file <none>
I20260619 04:43:44.148499 26639 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:44.148633 26639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:44.154726 26639 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260619 04:43:44.157899 26654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:44.159567 26639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:43:44.159793 26639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "c70ffb469e044de6bc18240b4d95a800"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "7394029d44beb34ca00a73ff1322b0ea"
server_key_iv: "a584e0c3f9940259a3135d477cb724ad"
server_key_version: "encryptionkey@0"
I20260619 04:43:44.160857 26639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:44.185456 26639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:44.189905 26639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:44.190222 26639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:44.209661 26639 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36203
I20260619 04:43:44.209697 26705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36203 every 8 connection(s)
I20260619 04:43:44.211290 26639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:43:44.215215 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26639
I20260619 04:43:44.216246 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:46087
--local_ip_for_outbound_sockets=127.9.224.65
--tserver_master_addrs=127.9.224.126:36203
--webserver_port=40539
--webserver_interface=127.9.224.65
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:43:44.220516 26706 sys_catalog.cc:263] Verifying existing consensus state
I20260619 04:43:44.226181 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap starting.
I20260619 04:43:44.247962 26706 log.cc:824] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:44.265702 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:43:44.266417 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Bootstrap complete.
I20260619 04:43:44.275808 26706 raft_consensus.cc:348] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:44.276822 26706 raft_consensus.cc:729] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70ffb469e044de6bc18240b4d95a800, State: Initialized, Role: FOLLOWER
I20260619 04:43:44.277539 26706 consensus_queue.cc:260] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:44.277793 26706 raft_consensus.cc:388] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:43:44.277931 26706 raft_consensus.cc:482] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:43:44.278151 26706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 2 FOLLOWER]: Advancing to term 3
I20260619 04:43:44.282155 26706 raft_consensus.cc:504] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:44.282802 26706 leader_election.cc:302] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c70ffb469e044de6bc18240b4d95a800; no voters:
I20260619 04:43:44.283550 26706 leader_election.cc:288] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260619 04:43:44.283694 26710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 04:43:44.284480 26710 raft_consensus.cc:686] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [term 3 LEADER]: Becoming Leader. State: Replica: c70ffb469e044de6bc18240b4d95a800, State: Running, Role: LEADER
I20260619 04:43:44.285092 26710 consensus_queue.cc:237] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } }
I20260619 04:43:44.285830 26706 sys_catalog.cc:564] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:43:44.287707 26711 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c70ffb469e044de6bc18240b4d95a800. Latest consensus state: current_term: 3 leader_uuid: "c70ffb469e044de6bc18240b4d95a800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } } }
I20260619 04:43:44.288081 26711 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: This master's current role is: LEADER
I20260619 04:43:44.288609 26712 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c70ffb469e044de6bc18240b4d95a800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70ffb469e044de6bc18240b4d95a800" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36203 } } }
I20260619 04:43:44.288919 26712 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800 [sys.catalog]: This master's current role is: LEADER
I20260619 04:43:44.294674 26715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:43:44.304199 26715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:43:44.305714 26715 catalog_manager.cc:1259] Loaded cluster ID: 13468089f1434e7797f144e2e3a2dc9d
I20260619 04:43:44.305836 26715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:43:44.310364 26715 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:43:44.312453 26715 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Loaded TSK: 0
I20260619 04:43:44.312621 26715 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c70ffb469e044de6bc18240b4d95a800: Loaded TSK: 1
F20260619 04:43:44.313781 26715 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc9af7e09ad google::LogMessage::Fail() at ??:0
@ 0x7fc9af7e388a google::LogMessage::SendToLog() at ??:0
@ 0x7fc9af7e04de google::LogMessage::Flush() at ??:0
@ 0x7fc9af7e1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc9b35447d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc9b353373e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc9c52131c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc9c5212783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc9c529e2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fc9c529e0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fc9c52e85e9 std::function<>::operator()() at ??:0
@ 0x7fc9c5216cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fc9c5214c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc9c529c610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fc9c529c439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc9b242c345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc9b242f91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc9b242f799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc9b240aeaf kudu::Thread::SuperviseThread() at ??:0
I20260619 04:43:44.397909 26735 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7fc9b56e46db start_thread at ??:0
@ 0x7fc9ae67a61f clone at ??:0
W20260619 04:43:44.623967 26708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:44.624253 26708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:44.624404 26708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:44.631937 26708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:44.632052 26708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:44.632265 26708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:43:44.642258 26708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:46087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=40539
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:44.643656 26708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:44.645008 26708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:44.659168 26754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:44.659291 26753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:44.659338 26756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:44.660620 26708 server_base.cc:1034] running on GCE node
I20260619 04:43:44.661289 26708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:44.662434 26708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:44.663673 26708 hybrid_clock.cc:648] HybridClock initialized: now 1781844224663618 us; error 44 us; skew 500 ppm
I20260619 04:43:44.664207 26708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:44 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844224, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:44.667778 26708 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:43:44.669373 26708 webserver.cc:460] Webserver started at http://127.9.224.65:40539/ using document root <none> and password file <none>
I20260619 04:43:44.670091 26708 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:44.670297 26708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:44.675874 26708 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 04:43:44.679390 26763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:44.681265 26708 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260619 04:43:44.681478 26708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b"
format_stamp: "Formatted at 2026-06-19 04:42:58 on dist-test-slave-9dgf"
server_key: "2f0d5ff148068d5de447e1ebd0b2bd6c"
server_key_iv: "c6f58f396e8f791355f3a4c171b8efa1"
server_key_version: "encryptionkey@0"
I20260619 04:43:44.683110 26708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:44.698638 26708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:44.703094 26708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:44.703361 26708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:44.704397 26708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:43:44.706414 26770 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 04:43:44.712301 26708 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 04:43:44.712432 26708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260619 04:43:44.712563 26708 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 04:43:44.715814 26708 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 04:43:44.715981 26708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.002s
I20260619 04:43:44.716312 26770 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Bootstrap starting.
I20260619 04:43:44.725245 26770 log.cc:824] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:43:44.741326 26770 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 04:43:44.742218 26770 tablet_bootstrap.cc:492] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Bootstrap complete.
I20260619 04:43:44.742937 26770 ts_tablet_manager.cc:1397] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Time spent bootstrapping tablet: real 0.027s user 0.025s sys 0.001s
I20260619 04:43:44.754089 26770 raft_consensus.cc:348] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:44.755373 26770 raft_consensus.cc:729] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51dfe74dbd3c4144bc0f1c3a0d7f892b, State: Initialized, Role: FOLLOWER
I20260619 04:43:44.756624 26770 consensus_queue.cc:260] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:44.758728 26770 ts_tablet_manager.cc:1428] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260619 04:43:44.764171 26708 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:46087
I20260619 04:43:44.764271 26878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:46087 every 8 connection(s)
I20260619 04:43:44.765851 26708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:43:44.766745 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26708
I20260619 04:43:44.767704 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:46449
--local_ip_for_outbound_sockets=127.9.224.66
--tserver_master_addrs=127.9.224.126:36203
--webserver_port=38777
--webserver_interface=127.9.224.66
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:43:44.773576 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:44.771424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:51831)
0619 04:43:44.772356 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:44.772642 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":405,"threads_started":1}
W20260619 04:43:44.774334 26879 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36203 (0 consecutive failures): Network error: Failed to ping master at 127.9.224.126:36203: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
I20260619 04:43:44.775336 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:44.774975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:40623)
0619 04:43:44.775152 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:44.775225 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260619 04:43:44.776571 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:44.776061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:34777)
0619 04:43:44.776243 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:44.776346 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 04:43:44.776914 26879 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 04:43:45.111150 26882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:45.111480 26882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:45.111651 26882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:45.119174 26882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:45.119334 26882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:45.119508 26882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:43:45.129597 26882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:46449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=38777
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:45.130991 26882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:45.132308 26882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:45.146025 26890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:45.146093 26887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:45.146044 26888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:45.146992 26882 server_base.cc:1034] running on GCE node
I20260619 04:43:45.147657 26882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:45.148669 26882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:45.149911 26882 hybrid_clock.cc:648] HybridClock initialized: now 1781844225149867 us; error 44 us; skew 500 ppm
I20260619 04:43:45.150292 26882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:45 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844225, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:45.153642 26882 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:43:45.155203 26882 webserver.cc:460] Webserver started at http://127.9.224.66:38777/ using document root <none> and password file <none>
I20260619 04:43:45.155910 26882 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:45.156057 26882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:45.161434 26882 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260619 04:43:45.164366 26897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:45.165838 26882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:43:45.166023 26882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "74aab8a009f14fec832d72a7932d4eae"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d709c33fb810e165faa7acb520607c5a"
server_key_iv: "e32d63eb8d5296c90f594ef8a08406c2"
server_key_version: "encryptionkey@0"
I20260619 04:43:45.167053 26882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:45.208074 26882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:45.212253 26882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:45.212540 26882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:45.213553 26882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:43:45.215076 26882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:43:45.215202 26882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:45.215333 26882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:43:45.215425 26882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:45.250178 26882 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:46449
I20260619 04:43:45.250356 27009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:46449 every 8 connection(s)
I20260619 04:43:45.251761 26882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:43:45.255221 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 26882
I20260619 04:43:45.255836 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:33963
--local_ip_for_outbound_sockets=127.9.224.67
--tserver_master_addrs=127.9.224.126:36203
--webserver_port=44079
--webserver_interface=127.9.224.67
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:44275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:43:45.257182 27012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.255054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:35651)
0619 04:43:45.255959 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.256264 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":407,"threads_started":1}
W20260619 04:43:45.257948 27010 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36203 (0 consecutive failures): Network error: Failed to ping master at 127.9.224.126:36203: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
I20260619 04:43:45.258862 27012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.258519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:37767)
0619 04:43:45.258672 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.258753 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260619 04:43:45.260118 27012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.259792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:34281)
0619 04:43:45.259931 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.260008 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 04:43:45.260406 27010 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 04:43:45.589459 27013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:43:45.589764 27013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:43:45.589962 27013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:43:45.597400 27013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:43:45.597532 27013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:43:45.597707 27013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:43:45.607828 27013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:44275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:33963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=44079
--tserver_master_addrs=127.9.224.126:36203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:43:45.609179 27013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:43:45.610585 27013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:43:45.624599 27018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:45.624577 27019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:43:45.624543 27021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:43:45.625349 27013 server_base.cc:1034] running on GCE node
I20260619 04:43:45.626058 27013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:43:45.627137 27013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:43:45.628458 27013 hybrid_clock.cc:648] HybridClock initialized: now 1781844225628340 us; error 54 us; skew 500 ppm
I20260619 04:43:45.628814 27013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:43:45 dist-test-slave-9dgf krb5kdc[25560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844225, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:43:45.632074 27013 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:43:45.633611 27013 webserver.cc:460] Webserver started at http://127.9.224.67:44079/ using document root <none> and password file <none>
I20260619 04:43:45.634371 27013 fs_manager.cc:359] Metadata directory not provided
I20260619 04:43:45.634521 27013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:43:45.639858 27013 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:43:45.642690 27028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:45.644163 27013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 04:43:45.644342 27013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "cab570ea4c2a49b1963b9077cbddd6e6"
format_stamp: "Formatted at 2026-06-19 04:42:59 on dist-test-slave-9dgf"
server_key: "d74a331f9aab1381d3e1fa2f9f7256d6"
server_key_iv: "b27320d75a6c94d5db00b998f1db30be"
server_key_version: "encryptionkey@0"
I20260619 04:43:45.645452 27013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:43:45.658716 27013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:43:45.663142 27013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:43:45.663430 27013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:43:45.664389 27013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:43:45.665745 27013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:43:45.665885 27013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:45.666018 27013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:43:45.666105 27013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:43:45.701701 27013 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:33963
I20260619 04:43:45.701790 27140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:33963 every 8 connection(s)
I20260619 04:43:45.703258 27013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:43:45.708470 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.706433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:50949)
0619 04:43:45.707236 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.707576 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":364,"threads_started":1}
W20260619 04:43:45.709076 27141 heartbeater.cc:644] Failed to heartbeat to 127.9.224.126:36203 (0 consecutive failures): Network error: Failed to ping master at 127.9.224.126:36203: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
I20260619 04:43:45.709935 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.709580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:51499)
0619 04:43:45.709752 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.709825 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 04:43:45.710784 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.710466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:38461)
0619 04:43:45.710601 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.710678 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 04:43:45.711020 27141 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 04:43:45.712071 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27013
I20260619 04:43:45.778558 27145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:45.777482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:49997)
0619 04:43:45.778004 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:45.778153 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":251,"threads_started":1}
I20260619 04:43:46.261931 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.261058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:36547)
0619 04:43:46.261578 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:46.261692 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":242,"threads_started":1}
I20260619 04:43:46.618541 27147 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:46.618902 27147 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:46.620741 27147 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
Jun 19 04:43:46 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844224, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
Jun 19 04:43:46 dist-test-slave-9dgf krb5kdc[25560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844224, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:43:46.657730 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.621144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46449 (local address 127.9.224.65:41937)
0619 04:43:46.634942 (+ 13798us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:46.634959 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:46.635447 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:46.637953 (+ 2506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:46.637964 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:46.638898 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:43:46.639626 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:46.639647 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.641241 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.641247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:46.643723 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:46.643738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.645973 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.645979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:46.646152 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:46.646772 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:43:46.646795 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:43:46.649030 (+ 2235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:43:46.652935 (+ 3905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:46.652938 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:46.652946 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:46.653850 (+ 904us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:46.654359 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:46.654362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:46.654407 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:46.654615 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:46.655747 (+ 1132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:43:46.655757 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:43:46.656277 (+ 520us) client_negotiation.cc:769] Sending connection context
0619 04:43:46.656612 (+ 335us) client_negotiation.cc:240] Negotiation successful
0619 04:43:46.657184 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13692,"mutex_wait_us":284,"spinlock_wait_cycles":30336,"thread_start_us":13102,"threads_started":1}
I20260619 04:43:46.657795 27150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.621256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:48407 (local address 127.9.224.67:33963)
0619 04:43:46.635443 (+ 14187us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:46.635459 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:46.635515 (+ 56us) server_negotiation.cc:407] Connection header received
0619 04:43:46.637084 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:46.637092 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:46.637463 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:46.637791 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:46.639832 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.641011 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.643881 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.644625 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.644773 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:46.649062 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:46.649080 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:46.649096 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:46.649135 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:46.652728 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:46.654371 (+ 1643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:46.654380 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:46.654395 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:46.654573 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:46.655009 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:46.655014 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:46.655017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:46.655640 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:46.655804 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:46.656930 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0619 04:43:46.657369 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13987,"thread_start_us":13875,"threads_started":1}
I20260619 04:43:46.658099 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.621509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:41937 (local address 127.9.224.66:46449)
0619 04:43:46.633745 (+ 12236us) server_negotiation.cc:206] Beginning negotiation
0619 04:43:46.633774 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0619 04:43:46.635407 (+ 1633us) server_negotiation.cc:407] Connection header received
0619 04:43:46.637190 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:43:46.637198 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:43:46.637534 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:43:46.637852 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:43:46.639833 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.641091 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.644960 (+ 3869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.645785 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.645917 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:46.649303 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:43:46.649311 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:43:46.649325 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:43:46.649371 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:43:46.652762 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:46.654011 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:46.654019 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:46.654025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:46.654186 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:43:46.654769 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:43:46.654772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:43:46.654774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:43:46.655554 (+ 780us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:43:46.655773 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0619 04:43:46.657255 (+ 1482us) server_negotiation.cc:299] Negotiation successful
0619 04:43:46.657676 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11932,"thread_start_us":12288,"threads_started":1}
I20260619 04:43:46.657752 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.621098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:33963 (local address 127.9.224.65:48407)
0619 04:43:46.634574 (+ 13476us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:46.634632 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 04:43:46.635419 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:43:46.637959 (+ 2540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:43:46.637965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:43:46.638882 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:43:46.639626 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:46.639647 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.641190 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.641197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:46.643722 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:43:46.643738 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:43:46.644788 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:43:46.644792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:43:46.645006 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:43:46.645730 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:43:46.645753 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:43:46.648684 (+ 2931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:43:46.652917 (+ 4233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:46.652928 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:46.652946 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:46.653850 (+ 904us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:46.654688 (+ 838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:43:46.654694 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:43:46.654698 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:43:46.654855 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:43:46.655761 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:43:46.655764 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:43:46.656277 (+ 513us) client_negotiation.cc:769] Sending connection context
0619 04:43:46.656612 (+ 335us) client_negotiation.cc:240] Negotiation successful
0619 04:43:46.657299 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13317,"mutex_wait_us":542,"spinlock_wait_cycles":58752,"thread_start_us":13582,"threads_started":1}
W20260619 04:43:46.661590 26767 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
W20260619 04:43:46.661993 26764 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:46.662137 26764 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b; no voters: 74aab8a009f14fec832d72a7932d4eae, cab570ea4c2a49b1963b9077cbddd6e6
I20260619 04:43:46.662616 27147 raft_consensus.cc:2726] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 04:43:46.712364 27152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.711525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:59971)
0619 04:43:46.711997 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:46.712126 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":212,"threads_started":1}
I20260619 04:43:46.779904 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:46.779481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:57621)
0619 04:43:46.779662 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:46.779768 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 04:43:47.263651 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:47.262907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:52665)
0619 04:43:47.263355 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:47.263491 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":248,"threads_started":1}
I20260619 04:43:47.713948 27154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:47.713201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:50565)
0619 04:43:47.713685 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:47.713773 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":273,"threads_started":1}
I20260619 04:43:47.781428 27155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:47.780738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:42771)
0619 04:43:47.781180 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:47.781260 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":215,"threads_started":1}
I20260619 04:43:48.265460 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:48.264711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:48363)
0619 04:43:48.265171 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:48.265259 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":244,"threads_started":1}
I20260619 04:43:48.715689 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:48.714923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:34669)
0619 04:43:48.715404 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:48.715491 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":256,"threads_started":1}
I20260619 04:43:48.753947 27158 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:48.754166 27158 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:48.754971 27158 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
W20260619 04:43:48.756058 26764 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
W20260619 04:43:48.756256 26767 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:48.756503 26767 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b; no voters: 74aab8a009f14fec832d72a7932d4eae, cab570ea4c2a49b1963b9077cbddd6e6
I20260619 04:43:48.756759 27158 raft_consensus.cc:2726] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 04:43:48.784343 27159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:48.783370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:37043)
0619 04:43:48.783897 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:48.784067 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":236,"threads_started":1}
I20260619 04:43:49.267392 27160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:49.266595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:35697)
0619 04:43:49.267115 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:49.267210 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":266,"threads_started":1}
I20260619 04:43:49.717654 27161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:49.716846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:41109)
0619 04:43:49.717350 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:49.717449 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":248,"threads_started":1}
I20260619 04:43:49.786825 27162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:49.785729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:57681)
0619 04:43:49.786426 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:49.786561 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":323,"threads_started":1}
I20260619 04:43:50.269048 27163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:50.268346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:44021)
0619 04:43:50.268796 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:50.268883 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":231,"threads_started":1}
I20260619 04:43:50.288358 27164 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:50.288658 27164 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:50.289288 27164 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
W20260619 04:43:50.290371 26764 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
W20260619 04:43:50.290591 26767 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:50.290706 26767 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b; no voters: 74aab8a009f14fec832d72a7932d4eae, cab570ea4c2a49b1963b9077cbddd6e6
I20260619 04:43:50.290934 27164 raft_consensus.cc:2726] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 04:43:50.719476 27165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:50.718685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:43879)
0619 04:43:50.719193 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:50.719303 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":244,"threads_started":1}
I20260619 04:43:50.789371 27166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:50.788146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:49851)
0619 04:43:50.788857 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:50.789035 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":323,"threads_started":1}
I20260619 04:43:51.270769 27167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:51.269954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:37415)
0619 04:43:51.270496 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:51.270581 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":328,"threads_started":1}
I20260619 04:43:51.721375 27168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:51.720445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:54983)
0619 04:43:51.720989 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:51.721099 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":288,"threads_started":1}
I20260619 04:43:51.791162 27169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:51.790449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:33759)
0619 04:43:51.790882 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:51.790966 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":229,"threads_started":1}
I20260619 04:43:52.272625 27170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:52.271734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:35769)
0619 04:43:52.272279 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:52.272383 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":264,"threads_started":1}
I20260619 04:43:52.723331 27171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:52.722476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:38943)
0619 04:43:52.723051 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:52.723145 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":253,"threads_started":1}
I20260619 04:43:52.792891 27172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:52.792129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:38659)
0619 04:43:52.792637 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:52.792724 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":249,"threads_started":1}
I20260619 04:43:53.274369 27173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:53.273556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:37167)
0619 04:43:53.274022 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:53.274121 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":237,"threads_started":1}
I20260619 04:43:53.725035 27174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:53.724284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:55487)
0619 04:43:53.724762 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:53.724851 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":235,"threads_started":1}
I20260619 04:43:53.794768 27175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:53.793843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:38965)
0619 04:43:53.794446 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:53.794579 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":284,"threads_started":1}
I20260619 04:43:54.276075 27176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:54.275270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:48465)
0619 04:43:54.275815 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:54.275906 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":279,"threads_started":1}
I20260619 04:43:54.399753 27177 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:54.399937 27177 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:54.400516 27177 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
W20260619 04:43:54.401539 26764 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
W20260619 04:43:54.401710 26767 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:54.401826 26767 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b; no voters: 74aab8a009f14fec832d72a7932d4eae, cab570ea4c2a49b1963b9077cbddd6e6
I20260619 04:43:54.402153 27177 raft_consensus.cc:2726] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 04:43:54.726836 27178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:54.725937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:49139)
0619 04:43:54.726580 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:54.726674 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":249,"threads_started":1}
I20260619 04:43:54.796825 27179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:54.795973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:50477)
0619 04:43:54.796506 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:54.796637 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":241,"threads_started":1}
I20260619 04:43:55.278218 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:55.277095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:53755)
0619 04:43:55.277787 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:55.277911 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":429,"threads_started":1}
I20260619 04:43:55.728659 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:55.727916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:59369)
0619 04:43:55.728390 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:55.728474 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":243,"threads_started":1}
I20260619 04:43:55.798743 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:55.797868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:52729)
0619 04:43:55.798429 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:55.798518 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":271,"threads_started":1}
I20260619 04:43:56.279860 27183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:56.279116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:55529)
0619 04:43:56.279600 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:56.279694 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":262,"threads_started":1}
I20260619 04:43:56.730566 27184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:56.729643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:37545)
0619 04:43:56.730206 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:56.730376 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":297,"threads_started":1}
I20260619 04:43:56.800590 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:56.799821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:45581)
0619 04:43:56.800329 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:56.800421 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":255,"threads_started":1}
I20260619 04:43:57.281458 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:57.280754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:57339)
0619 04:43:57.281205 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:57.281286 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":228,"threads_started":1}
I20260619 04:43:57.732316 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:57.731591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:32811)
0619 04:43:57.732050 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:57.732138 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":237,"threads_started":1}
I20260619 04:43:57.802522 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:57.801675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:41391)
0619 04:43:57.802177 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:57.802342 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":269,"threads_started":1}
I20260619 04:43:58.283335 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:58.282570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:36341)
0619 04:43:58.283049 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:58.283165 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":266,"threads_started":1}
I20260619 04:43:58.734072 27190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:58.733338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:45371)
0619 04:43:58.733821 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:58.733913 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":248,"threads_started":1}
I20260619 04:43:58.804145 27191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:58.803449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:48079)
0619 04:43:58.803865 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:58.803964 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":216,"threads_started":1}
I20260619 04:43:59.149192 27192 raft_consensus.cc:482] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:43:59.149411 27192 raft_consensus.cc:504] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dfe74dbd3c4144bc0f1c3a0d7f892b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 46087 } } peers { permanent_uuid: "cab570ea4c2a49b1963b9077cbddd6e6" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 33963 } } peers { permanent_uuid: "74aab8a009f14fec832d72a7932d4eae" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46449 } }
I20260619 04:43:59.150267 27192 leader_election.cc:288] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963), 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449)
W20260619 04:43:59.151209 26764 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab570ea4c2a49b1963b9077cbddd6e6 (127.9.224.67:33963): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
W20260619 04:43:59.151388 26767 leader_election.cc:341] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 74aab8a009f14fec832d72a7932d4eae (127.9.224.66:46449): Not found: Tablet not found: b03c772044fa44129f3cc7492f9819fc
I20260619 04:43:59.151600 26767 leader_election.cc:302] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51dfe74dbd3c4144bc0f1c3a0d7f892b; no voters: 74aab8a009f14fec832d72a7932d4eae, cab570ea4c2a49b1963b9077cbddd6e6
I20260619 04:43:59.151863 27192 raft_consensus.cc:2726] T b03c772044fa44129f3cc7492f9819fc P 51dfe74dbd3c4144bc0f1c3a0d7f892b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 04:43:59.285311 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:59.284391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:49603)
0619 04:43:59.284994 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:59.285116 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":357,"threads_started":1}
I20260619 04:43:59.736038 27194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:59.735168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:59573)
0619 04:43:59.735702 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:59.735829 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":302,"threads_started":1}
I20260619 04:43:59.806376 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:43:59.805458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.65:37829)
0619 04:43:59.805958 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0619 04:43:59.806070 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":270,"threads_started":1}
I20260619 04:44:00.287467 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:00.286514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.66:48119)
0619 04:44:00.287019 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:00.287212 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":234,"threads_started":1}
I20260619 04:44:00.721014 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 26708
I20260619 04:44:00.738507 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:00.737576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36203 (local address 127.9.224.67:49207)
0619 04:44:00.738168 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:00.738349 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.126:36203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":317,"threads_started":1}
I20260619 04:44:00.746426 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:00.722191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40020 (local address 127.9.224.65:46087)
0619 04:44:00.722935 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:00.722945 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:00.722975 (+ 30us) server_negotiation.cc:407] Connection header received
0619 04:44:00.723081 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:00.723093 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:00.723416 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:00.723596 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:00.725130 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:00.726093 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:00.727432 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:00.728031 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:00.728185 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:00.738019 (+ 9834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:00.738045 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:00.738070 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:00.738141 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:00.742653 (+ 4512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:00.743679 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:00.743692 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:00.743700 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:00.743906 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:00.744411 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:00.744416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:00.744420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:00.744890 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:00.745241 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:00.745583 (+ 342us) server_negotiation.cc:299] Negotiation successful
0619 04:44:00.745876 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":299,"threads_started":1}
I20260619 04:44:00.747900 26874 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:00.840883 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 26708
I20260619 04:44:00.859045 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 26882
I20260619 04:44:00.873394 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:00.859886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36686 (local address 127.9.224.66:46449)
0619 04:44:00.860435 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:00.860440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:00.860457 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:44:00.860515 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:00.860518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:00.860629 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:00.860724 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:00.862142 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:00.863295 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:00.864590 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:00.865105 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:00.865217 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:00.867993 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:00.867998 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:00.868002 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:00.868039 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:00.870767 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:00.871611 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:00.871616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:00.871618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:00.871798 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:00.872138 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:00.872141 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:00.872143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:00.872470 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:00.872697 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:00.872925 (+ 228us) server_negotiation.cc:299] Negotiation successful
0619 04:44:00.873098 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":336,"threads_started":1}
I20260619 04:44:00.874187 27005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:00.959822 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 26882
I20260619 04:44:00.978066 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27013
I20260619 04:44:00.992858 27203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:00.979212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59702 (local address 127.9.224.67:33963)
0619 04:44:00.979764 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:00.979769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:00.979786 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:44:00.979839 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:00.979842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:00.979908 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:00.979997 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:00.981469 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:00.982414 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:00.983681 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:00.984120 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:00.984222 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:00.987221 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:00.987226 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:00.987229 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:00.987264 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:00.990046 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:00.990936 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:00.990940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:00.990943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:00.991125 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:00.991502 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:00.991506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:00.991508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:00.991839 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:00.992095 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:00.992340 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 04:44:00.992517 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":265,"threads_started":1}
I20260619 04:44:00.993580 27136 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:01.077998 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27013
2026-06-19T04:44:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64674 ms)
[----------] 30 tests from SecurityITest (300222 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:01 dist-test-slave-9dgf krb5kdc[27207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:01 dist-test-slave-9dgf krb5kdc[27207](info): set up 2 sockets
Jun 19 04:44:01 dist-test-slave-9dgf krb5kdc[27207](info): commencing operation
krb5kdc: starting...
W20260619 04:44:02.270655 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:02 dist-test-slave-9dgf krb5kdc[27207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:02.538139 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36767
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:02.884020 27220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:02.884328 27220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:02.884423 27220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:02.891918 27220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:02.892100 27220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:02.892154 27220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:02.892292 27220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:02.892374 27220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:02.902668 27220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:02.903997 27220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:02.905299 27220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:02.917253 27225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:02.917307 27226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:02.917277 27228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:02.918777 27220 server_base.cc:1034] running on GCE node
I20260619 04:44:02.919669 27220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:02.921206 27220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:02.922407 27220 hybrid_clock.cc:648] HybridClock initialized: now 1781844242922341 us; error 55 us; skew 500 ppm
I20260619 04:44:02.922806 27220 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:02 dist-test-slave-9dgf krb5kdc[27207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844242, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:02.926098 27220 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:02.927624 27220 webserver.cc:460] Webserver started at http://127.9.224.126:34191/ using document root <none> and password file <none>
I20260619 04:44:02.928324 27220 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:02.928449 27220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:02.928779 27220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:02.931887 27220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "fe8367f0908c41928250e48dd17039ca"
format_stamp: "Formatted at 2026-06-19 04:44:02 on dist-test-slave-9dgf"
server_key: "b58d531855592c31f3651c9a4620c66c"
server_key_iv: "e2b0341e43c31fd1c3564093b2d6952c"
server_key_version: "encryptionkey@0"
I20260619 04:44:02.932654 27220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "fe8367f0908c41928250e48dd17039ca"
format_stamp: "Formatted at 2026-06-19 04:44:02 on dist-test-slave-9dgf"
server_key: "b58d531855592c31f3651c9a4620c66c"
server_key_iv: "e2b0341e43c31fd1c3564093b2d6952c"
server_key_version: "encryptionkey@0"
I20260619 04:44:02.937786 27220 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 04:44:02.941187 27235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:02.942718 27220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 04:44:02.942902 27220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "fe8367f0908c41928250e48dd17039ca"
format_stamp: "Formatted at 2026-06-19 04:44:02 on dist-test-slave-9dgf"
server_key: "b58d531855592c31f3651c9a4620c66c"
server_key_iv: "e2b0341e43c31fd1c3564093b2d6952c"
server_key_version: "encryptionkey@0"
I20260619 04:44:02.943107 27220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:02.956797 27220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:02.961061 27220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:02.961361 27220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:02.980479 27220 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36767
I20260619 04:44:02.980499 27286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36767 every 8 connection(s)
I20260619 04:44:02.981912 27220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:02.984457 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27220
I20260619 04:44:02.984678 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:02.985500 10113 external_mini_cluster.cc:1428] Setting key 9fa779327f73061bd94f36b06c0aec46
I20260619 04:44:02.986547 27287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 04:44:02 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:03.001995 27287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca: Bootstrap starting.
I20260619 04:44:03.006138 27287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:03.007575 27287 log.cc:824] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:03.011477 27287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca: No bootstrap required, opened a new log
I20260619 04:44:03.011801 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:02.987677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55760 (local address 127.9.224.126:36767)
0619 04:44:02.988462 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:02.988474 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:02.988522 (+ 48us) server_negotiation.cc:407] Connection header received
0619 04:44:02.990075 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:02.990097 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:02.990581 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:02.990920 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:02.992720 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:02.994131 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:02.996070 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:02.996852 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:02.996991 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:03.002444 (+ 5453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:03.002452 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:03.002469 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:03.002515 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:03.006759 (+ 4244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:03.007812 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:03.007821 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:03.007828 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:03.008022 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:03.008548 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:03.008552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:03.008556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:03.009341 (+ 785us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:03.009583 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:03.010183 (+ 600us) server_negotiation.cc:299] Negotiation successful
0619 04:44:03.010705 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":362,"threads_started":1}
I20260619 04:44:03.021065 27287 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8367f0908c41928250e48dd17039ca" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36767 } }
I20260619 04:44:03.021520 27287 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:03.021651 27287 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8367f0908c41928250e48dd17039ca, State: Initialized, Role: FOLLOWER
I20260619 04:44:03.022396 27287 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8367f0908c41928250e48dd17039ca" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36767 } }
I20260619 04:44:03.022653 27287 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:03.022818 27287 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:03.023025 27287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:03.025470 27287 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8367f0908c41928250e48dd17039ca" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36767 } }
I20260619 04:44:03.025987 27287 leader_election.cc:302] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe8367f0908c41928250e48dd17039ca; no voters:
I20260619 04:44:03.026643 27287 leader_election.cc:288] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:03.026825 27292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:03.027549 27292 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [term 1 LEADER]: Becoming Leader. State: Replica: fe8367f0908c41928250e48dd17039ca, State: Running, Role: LEADER
I20260619 04:44:03.028075 27292 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8367f0908c41928250e48dd17039ca" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36767 } }
I20260619 04:44:03.028980 27287 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:03.031685 27293 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe8367f0908c41928250e48dd17039ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8367f0908c41928250e48dd17039ca" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36767 } } }
I20260619 04:44:03.032210 27293 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:03.032152 27294 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe8367f0908c41928250e48dd17039ca. Latest consensus state: current_term: 1 leader_uuid: "fe8367f0908c41928250e48dd17039ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8367f0908c41928250e48dd17039ca" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36767 } } }
I20260619 04:44:03.032831 27294 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:03.034282 27298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:03.041863 27298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:03.052807 27298 catalog_manager.cc:1347] Generated new cluster ID: 7c16e48a8fec479d81de020d8c4cf91d
I20260619 04:44:03.052953 27298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:03.073603 27298 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:03.075229 27298 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:03.090832 27298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca: Generated new TSK 0
I20260619 04:44:03.091734 27298 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:44:03.175266 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36767
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:03.535622 27313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:03.535910 27313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:03.536063 27313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:03.543741 27313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:03.543859 27313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:03.544067 27313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:44:03.554458 27313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36767
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:03.555794 27313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:03.557157 27313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:03.570818 27321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:03.570896 27319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:03.570945 27318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:03.572019 27313 server_base.cc:1034] running on GCE node
I20260619 04:44:03.572642 27313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:03.573645 27313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:03.574851 27313 hybrid_clock.cc:648] HybridClock initialized: now 1781844243574784 us; error 55 us; skew 500 ppm
I20260619 04:44:03.575181 27313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:03 dist-test-slave-9dgf krb5kdc[27207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844243, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:03.578574 27313 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:44:03.580127 27313 webserver.cc:460] Webserver started at http://127.9.224.65:36889/ using document root <none> and password file <none>
I20260619 04:44:03.580832 27313 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:03.580974 27313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:03.581303 27313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:03.584335 27313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce"
format_stamp: "Formatted at 2026-06-19 04:44:03 on dist-test-slave-9dgf"
server_key: "130a681c7dc7187f851a805c6a78e3c0"
server_key_iv: "5b5e4e48ba779cb8ac96dda4f0586af4"
server_key_version: "encryptionkey@0"
I20260619 04:44:03.585127 27313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce"
format_stamp: "Formatted at 2026-06-19 04:44:03 on dist-test-slave-9dgf"
server_key: "130a681c7dc7187f851a805c6a78e3c0"
server_key_iv: "5b5e4e48ba779cb8ac96dda4f0586af4"
server_key_version: "encryptionkey@0"
I20260619 04:44:03.590862 27313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:44:03.594594 27328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:03.596028 27313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:03.596227 27313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce"
format_stamp: "Formatted at 2026-06-19 04:44:03 on dist-test-slave-9dgf"
server_key: "130a681c7dc7187f851a805c6a78e3c0"
server_key_iv: "5b5e4e48ba779cb8ac96dda4f0586af4"
server_key_version: "encryptionkey@0"
I20260619 04:44:03.596454 27313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:03.616142 27313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:03.620782 27313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:03.621088 27313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:03.622097 27313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:03.623512 27313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:03.623615 27313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:03.623772 27313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:03.623844 27313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:03.657711 27313 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:33841
I20260619 04:44:03.657795 27440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:33841 every 8 connection(s)
I20260619 04:44:03.659057 27313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:44:03.665516 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27313
I20260619 04:44:03.665803 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:44:03.666522 10113 external_mini_cluster.cc:1428] Setting key 3920423657ed3255af30aa764052c9ea
Jun 19 04:44:03 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844243, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:03.682873 27443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:03.661863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:46133 (local address 127.9.224.126:36767)
0619 04:44:03.662399 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:03.662404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:03.663289 (+ 885us) server_negotiation.cc:407] Connection header received
0619 04:44:03.665328 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:03.665334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:03.665432 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:03.665554 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:03.667360 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:03.668425 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:03.670973 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:03.671349 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:03.671449 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:03.675785 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:03.675790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:03.675793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:03.675827 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:03.679149 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:03.680033 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:03.680041 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:03.680048 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:03.680214 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:03.680710 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:03.680717 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:03.680723 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:03.681112 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:03.681292 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:03.682092 (+ 800us) server_negotiation.cc:299] Negotiation successful
0619 04:44:03.682396 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":305,"threads_started":1}
I20260619 04:44:03.683648 27444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:03.662283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36767 (local address 127.9.224.65:46133)
0619 04:44:03.663090 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:03.663143 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:03.665028 (+ 1885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:03.665838 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:03.665848 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:03.666491 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:03.667157 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:03.667175 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:03.668607 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:03.668613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:03.670827 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:03.670848 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:03.671592 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:03.671602 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:03.671935 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:03.672696 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:03.672735 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:03.675514 (+ 2779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:03.679332 (+ 3818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:03.679341 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:03.679355 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:03.679888 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:03.680342 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:03.680346 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:03.680348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:03.680545 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:03.681262 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:03.681269 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:03.681683 (+ 414us) client_negotiation.cc:769] Sending connection context
0619 04:44:03.681933 (+ 250us) client_negotiation.cc:240] Negotiation successful
0619 04:44:03.682442 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":309,"threads_started":1}
I20260619 04:44:03.685467 27441 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36767
I20260619 04:44:03.685825 27441 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:03.686765 27441 heartbeater.cc:511] Master 127.9.224.126:36767 requested a full tablet report, sending...
I20260619 04:44:03.689087 27252 ts_manager.cc:194] Registered new tserver with Master: fd48b9440c0542a4b0bc6a2eba1e07ce (127.9.224.65:33841)
I20260619 04:44:03.690748 27252 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:46133
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:44:03.727089 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36767
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:04.065069 27447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:04.065416 27447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:04.065591 27447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:04.073283 27447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:04.073451 27447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:04.073640 27447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:44:04.084002 27447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36767
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:04.085381 27447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:04.086769 27447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:04.100567 27452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:04.100613 27455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:04.100534 27453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:04.101591 27447 server_base.cc:1034] running on GCE node
I20260619 04:44:04.102205 27447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:04.103242 27447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:04.104506 27447 hybrid_clock.cc:648] HybridClock initialized: now 1781844244104430 us; error 64 us; skew 500 ppm
I20260619 04:44:04.104874 27447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:04 dist-test-slave-9dgf krb5kdc[27207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844244, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:04.108393 27447 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:44:04.109947 27447 webserver.cc:460] Webserver started at http://127.9.224.66:37821/ using document root <none> and password file <none>
I20260619 04:44:04.110697 27447 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:04.110802 27447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:04.111052 27447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:04.113968 27447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "091850a644f0443b9e1be5609dec2309"
format_stamp: "Formatted at 2026-06-19 04:44:04 on dist-test-slave-9dgf"
server_key: "5ca0082b8d96c58d3d621a9721ee612c"
server_key_iv: "7bb6ad3733797d58034edb338f67f3f9"
server_key_version: "encryptionkey@0"
I20260619 04:44:04.114766 27447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "091850a644f0443b9e1be5609dec2309"
format_stamp: "Formatted at 2026-06-19 04:44:04 on dist-test-slave-9dgf"
server_key: "5ca0082b8d96c58d3d621a9721ee612c"
server_key_iv: "7bb6ad3733797d58034edb338f67f3f9"
server_key_version: "encryptionkey@0"
I20260619 04:44:04.120477 27447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:04.124593 27462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:04.126140 27447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:44:04.126377 27447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "091850a644f0443b9e1be5609dec2309"
format_stamp: "Formatted at 2026-06-19 04:44:04 on dist-test-slave-9dgf"
server_key: "5ca0082b8d96c58d3d621a9721ee612c"
server_key_iv: "7bb6ad3733797d58034edb338f67f3f9"
server_key_version: "encryptionkey@0"
I20260619 04:44:04.126644 27447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:04.146991 27447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:04.151417 27447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:04.151741 27447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:04.152810 27447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:04.154304 27447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:04.154381 27447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:04.154520 27447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:04.154578 27447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:04.190160 27447 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:35587
I20260619 04:44:04.190207 27574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:35587 every 8 connection(s)
I20260619 04:44:04.191538 27447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:44:04.193691 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27447
I20260619 04:44:04.193904 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:44:04.194514 10113 external_mini_cluster.cc:1428] Setting key 768a2201a7bcefa7174830bd0bc44b06
Jun 19 04:44:04 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844244, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:04.214438 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.194515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:59073 (local address 127.9.224.126:36767)
0619 04:44:04.195048 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:04.195054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:04.196315 (+ 1261us) server_negotiation.cc:407] Connection header received
0619 04:44:04.198203 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:04.198211 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:04.198341 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:04.198468 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:04.200089 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.201282 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.203020 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.203810 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.203959 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.208296 (+ 4337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:04.208301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:04.208304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:04.208341 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:04.211152 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:04.211951 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:04.211963 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:04.211965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:04.212109 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:04.212556 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:04.212563 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:04.212570 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:04.212835 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:04.213013 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:04.213753 (+ 740us) server_negotiation.cc:299] Negotiation successful
0619 04:44:04.213987 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":258,"threads_started":1}
I20260619 04:44:04.215626 27578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.195198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36767 (local address 127.9.224.66:59073)
0619 04:44:04.196149 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:04.196203 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:04.197911 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:04.198728 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:04.198736 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:04.199268 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:04.199850 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.199867 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.201468 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.201472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.202864 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.202877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.204042 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.204048 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.204271 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.205093 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:04.205134 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:04.208034 (+ 2900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:04.211316 (+ 3282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:04.211327 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:04.211345 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:04.211809 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:04.212227 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:04.212232 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:04.212235 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:04.212429 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:04.212969 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:04.212979 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:04.213366 (+ 387us) client_negotiation.cc:769] Sending connection context
0619 04:44:04.213660 (+ 294us) client_negotiation.cc:240] Negotiation successful
0619 04:44:04.214273 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":443,"threads_started":1}
I20260619 04:44:04.217304 27575 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36767
I20260619 04:44:04.217684 27575 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:04.218741 27575 heartbeater.cc:511] Master 127.9.224.126:36767 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
I20260619 04:44:04.220607 27252 ts_manager.cc:194] Registered new tserver with Master: 091850a644f0443b9e1be5609dec2309 (127.9.224.66:35587)
I20260619 04:44:04.221501 27252 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:59073
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:44:04.254727 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36767
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:04.598459 27581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:04.598762 27581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:04.598920 27581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:04.606411 27581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:04.606530 27581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:04.606760 27581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:44:04.616818 27581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36767
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:04.618219 27581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:04.619729 27581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:04.633935 27589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:04.634004 27587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:04.633975 27586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:04.634847 27581 server_base.cc:1034] running on GCE node
I20260619 04:44:04.635555 27581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:04.636612 27581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:04.637869 27581 hybrid_clock.cc:648] HybridClock initialized: now 1781844244637812 us; error 60 us; skew 500 ppm
I20260619 04:44:04.638223 27581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:04 dist-test-slave-9dgf krb5kdc[27207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844244, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:04.641686 27581 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:44:04.643419 27581 webserver.cc:460] Webserver started at http://127.9.224.67:40653/ using document root <none> and password file <none>
I20260619 04:44:04.644138 27581 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:04.644241 27581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:04.644505 27581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:04.647763 27581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "8353d9ecd92c45838418204b62b08cf7"
format_stamp: "Formatted at 2026-06-19 04:44:04 on dist-test-slave-9dgf"
server_key: "ce7b273c05cd23c7edc25e653945c46b"
server_key_iv: "a94fe37bd416bb6ee251ff8b4a68cfa2"
server_key_version: "encryptionkey@0"
I20260619 04:44:04.648489 27581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "8353d9ecd92c45838418204b62b08cf7"
format_stamp: "Formatted at 2026-06-19 04:44:04 on dist-test-slave-9dgf"
server_key: "ce7b273c05cd23c7edc25e653945c46b"
server_key_iv: "a94fe37bd416bb6ee251ff8b4a68cfa2"
server_key_version: "encryptionkey@0"
I20260619 04:44:04.653810 27581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:44:04.657490 27596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:04.659224 27581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:04.659397 27581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "8353d9ecd92c45838418204b62b08cf7"
format_stamp: "Formatted at 2026-06-19 04:44:04 on dist-test-slave-9dgf"
server_key: "ce7b273c05cd23c7edc25e653945c46b"
server_key_iv: "a94fe37bd416bb6ee251ff8b4a68cfa2"
server_key_version: "encryptionkey@0"
I20260619 04:44:04.659627 27581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:04.677758 27581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:04.682406 27581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:04.682660 27581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:04.683638 27581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:04.684988 27581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:04.685060 27581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:04.685158 27581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:04.685202 27581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:04.694545 27441 heartbeater.cc:503] Master 127.9.224.126:36767 was elected leader, sending a full tablet report...
I20260619 04:44:04.720471 27581 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:38897
I20260619 04:44:04.720520 27708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:38897 every 8 connection(s)
I20260619 04:44:04.721905 27581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:44:04.732060 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27581
I20260619 04:44:04.732266 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:44:04.732755 10113 external_mini_cluster.cc:1428] Setting key e4510d162fe709edc7e8744f136fee41
Jun 19 04:44:04 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844244, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:04.746695 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.725100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:55353 (local address 127.9.224.126:36767)
0619 04:44:04.725628 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:04.725633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:04.726630 (+ 997us) server_negotiation.cc:407] Connection header received
0619 04:44:04.728571 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:04.728577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:04.728684 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:04.728806 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:04.730647 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.731586 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.733667 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.734280 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.734415 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.739006 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:04.739015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:04.739021 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:04.739081 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:04.743057 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:04.744141 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:04.744147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:04.744150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:04.744299 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:04.744755 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:04.744760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:04.744763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:04.745048 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:04.745216 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:04.745951 (+ 735us) server_negotiation.cc:299] Negotiation successful
0619 04:44:04.746186 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":261,"threads_started":1}
I20260619 04:44:04.748008 27712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.725643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36767 (local address 127.9.224.67:55353)
0619 04:44:04.726420 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:04.726460 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:04.728275 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:04.729065 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:04.729074 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:04.729713 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:04.730466 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.730489 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.731794 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.731799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.733463 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.733481 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.734514 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.734519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.734800 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.735581 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:04.735618 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:04.738711 (+ 3093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:04.743225 (+ 4514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:04.743239 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:04.743262 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:04.744003 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:04.744416 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:04.744421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:04.744425 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:04.744631 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:04.745183 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:04.745191 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:04.745571 (+ 380us) client_negotiation.cc:769] Sending connection context
0619 04:44:04.745848 (+ 277us) client_negotiation.cc:240] Negotiation successful
0619 04:44:04.746473 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":277,"threads_started":1}
I20260619 04:44:04.749522 27709 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36767
I20260619 04:44:04.749908 27709 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:04.750720 27709 heartbeater.cc:511] Master 127.9.224.126:36767 requested a full tablet report, sending...
I20260619 04:44:04.752390 27252 ts_manager.cc:194] Registered new tserver with Master: 8353d9ecd92c45838418204b62b08cf7 (127.9.224.67:38897)
I20260619 04:44:04.753255 27252 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:55353
I20260619 04:44:04.761831 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:44:04.780880 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.767195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32908 (local address 127.9.224.126:36767)
0619 04:44:04.767470 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:04.767478 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:04.767831 (+ 353us) server_negotiation.cc:407] Connection header received
0619 04:44:04.767982 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:04.767986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:04.768061 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:04.768161 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:04.769692 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.770540 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.771890 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.772351 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.772459 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.775320 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:04.775325 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:04.775328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:04.775368 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:04.778045 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:04.778848 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:04.778853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:04.778855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:04.778980 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:04.779330 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:04.779333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:04.779335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:04.779677 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:04.779872 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:04.780277 (+ 405us) server_negotiation.cc:299] Negotiation successful
0619 04:44:04.780463 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 04:44:04.785437 27252 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32908:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:44:04.793252 27252 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:44:04.818985 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.806882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60750 (local address 127.9.224.67:38897)
0619 04:44:04.811767 (+ 4885us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:04.811774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:04.811800 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:44:04.811876 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:04.811881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:04.812046 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:04.812253 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:04.812776 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.814327 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.816724 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.817772 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.817905 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.818146 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:04.818433 (+ 287us) server_negotiation.cc:299] Negotiation successful
0619 04:44:04.818612 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4731,"thread_start_us":4571,"threads_started":1}
I20260619 04:44:04.818987 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.806680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:38897 (local address 127.0.0.1:60750)
0619 04:44:04.807438 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:04.807481 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:04.808141 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:04.812232 (+ 4091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:04.812236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:04.812263 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:04.812601 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.812611 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.814507 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.814512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.816573 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.816583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.818016 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.818022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.818166 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.818204 (+ 38us) client_negotiation.cc:769] Sending connection context
0619 04:44:04.818315 (+ 111us) client_negotiation.cc:240] Negotiation successful
0619 04:44:04.818466 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":76,"thread_start_us":598,"threads_started":1}
I20260619 04:44:04.819033 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.807280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:35587 (local address 127.0.0.1:32862)
0619 04:44:04.808807 (+ 1527us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:04.808832 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:04.808965 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:04.810287 (+ 1322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:04.810295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:04.810328 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:04.810841 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.810854 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.813155 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.813161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.815699 (+ 2538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.815711 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.817528 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.817534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.817761 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.817833 (+ 72us) client_negotiation.cc:769] Sending connection context
0619 04:44:04.818400 (+ 567us) client_negotiation.cc:240] Negotiation successful
0619 04:44:04.818541 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1353,"mutex_wait_us":151,"thread_start_us":1197,"threads_started":1}
I20260619 04:44:04.819690 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.807803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32862 (local address 127.9.224.66:35587)
0619 04:44:04.809493 (+ 1690us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:04.809505 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:04.809537 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:44:04.809665 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:04.809673 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:04.809952 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:04.811066 (+ 1114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:04.811336 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.813000 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.815864 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.817317 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.817468 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.817690 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:04.819166 (+ 1476us) server_negotiation.cc:299] Negotiation successful
0619 04:44:04.819336 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1512,"thread_start_us":1376,"threads_started":1}
I20260619 04:44:04.819864 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.808635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:33841 (local address 127.0.0.1:55514)
0619 04:44:04.809732 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:04.809752 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:04.809848 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:04.811354 (+ 1506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:04.811358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:04.811387 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:04.811795 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.811808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.813757 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.813762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.816023 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:04.816038 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.817880 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.817886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:04.818112 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.818148 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 04:44:04.818216 (+ 68us) client_negotiation.cc:240] Negotiation successful
0619 04:44:04.819524 (+ 1308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":4,"thread_start_us":2387,"threads_started":1}
I20260619 04:44:04.820856 27727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:04.809320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.9.224.65:33841)
0619 04:44:04.810503 (+ 1183us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:04.810515 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:04.810565 (+ 50us) server_negotiation.cc:407] Connection header received
0619 04:44:04.810713 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:04.810722 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:04.811130 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:04.812008 (+ 878us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:04.812271 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.813591 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.816190 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:04.817610 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:04.820101 (+ 2491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:04.820317 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:04.820387 (+ 70us) server_negotiation.cc:299] Negotiation successful
0619 04:44:04.820555 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":958,"thread_start_us":1837,"threads_started":1}
I20260619 04:44:04.823493 27510 tablet_service.cc:1467] Processing CreateTablet for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 (DEFAULT_TABLE table=test-table [id=5d9fc88dde44426e9a95d1d0dee01795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:04.823498 27644 tablet_service.cc:1467] Processing CreateTablet for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 (DEFAULT_TABLE table=test-table [id=5d9fc88dde44426e9a95d1d0dee01795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:04.824205 27376 tablet_service.cc:1467] Processing CreateTablet for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 (DEFAULT_TABLE table=test-table [id=5d9fc88dde44426e9a95d1d0dee01795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:04.825163 27510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:04.825155 27644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:04.825538 27376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:04.839130 27728 tablet_bootstrap.cc:492] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Bootstrap starting.
I20260619 04:44:04.842968 27728 tablet_bootstrap.cc:654] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:04.844559 27728 log.cc:824] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:04.845652 27730 tablet_bootstrap.cc:492] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Bootstrap starting.
I20260619 04:44:04.846704 27729 tablet_bootstrap.cc:492] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Bootstrap starting.
I20260619 04:44:04.849472 27730 tablet_bootstrap.cc:654] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:04.850553 27729 tablet_bootstrap.cc:654] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:04.850593 27730 log.cc:824] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:04.851063 27728 tablet_bootstrap.cc:492] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: No bootstrap required, opened a new log
I20260619 04:44:04.851363 27728 ts_tablet_manager.cc:1397] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260619 04:44:04.851831 27729 log.cc:824] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:04.853668 27730 tablet_bootstrap.cc:492] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: No bootstrap required, opened a new log
I20260619 04:44:04.853950 27730 ts_tablet_manager.cc:1397] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 04:44:04.855008 27729 tablet_bootstrap.cc:492] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: No bootstrap required, opened a new log
I20260619 04:44:04.855263 27729 ts_tablet_manager.cc:1397] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 04:44:04.861747 27730 raft_consensus.cc:348] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:04.862170 27730 raft_consensus.cc:374] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:04.862298 27730 raft_consensus.cc:729] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 091850a644f0443b9e1be5609dec2309, State: Initialized, Role: FOLLOWER
I20260619 04:44:04.862286 27728 raft_consensus.cc:348] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:04.862753 27728 raft_consensus.cc:374] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:04.862856 27728 raft_consensus.cc:729] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd48b9440c0542a4b0bc6a2eba1e07ce, State: Initialized, Role: FOLLOWER
I20260619 04:44:04.863014 27730 consensus_queue.cc:260] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:04.863468 27728 consensus_queue.cc:260] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:04.864534 27575 heartbeater.cc:503] Master 127.9.224.126:36767 was elected leader, sending a full tablet report...
I20260619 04:44:04.865239 27730 ts_tablet_manager.cc:1428] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260619 04:44:04.867173 27729 raft_consensus.cc:348] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:04.867661 27729 raft_consensus.cc:374] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:04.867774 27729 raft_consensus.cc:729] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8353d9ecd92c45838418204b62b08cf7, State: Initialized, Role: FOLLOWER
I20260619 04:44:04.868407 27729 consensus_queue.cc:260] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:04.870116 27729 ts_tablet_manager.cc:1428] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260619 04:44:04.872082 27728 ts_tablet_manager.cc:1428] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Time spent starting tablet: real 0.021s user 0.004s sys 0.017s
I20260619 04:44:04.872934 27709 heartbeater.cc:503] Master 127.9.224.126:36767 was elected leader, sending a full tablet report...
W20260619 04:44:04.911612 27442 tablet.cc:2369] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:04.943653 27576 tablet.cc:2369] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:04.974768 27710 tablet.cc:2369] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:05.030457 27735 raft_consensus.cc:482] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:05.030818 27735 raft_consensus.cc:504] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:05.032630 27735 leader_election.cc:288] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8353d9ecd92c45838418204b62b08cf7 (127.9.224.67:38897), 091850a644f0443b9e1be5609dec2309 (127.9.224.66:35587)
I20260619 04:44:05.039767 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.033218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:53045 (local address 127.9.224.67:38897)
0619 04:44:05.033406 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:05.033414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:05.034182 (+ 768us) server_negotiation.cc:407] Connection header received
0619 04:44:05.034412 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:05.034417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:05.034481 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:05.034568 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:05.035297 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.036069 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.037932 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.038776 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.038970 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.039048 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:05.039344 (+ 296us) server_negotiation.cc:299] Negotiation successful
0619 04:44:05.039471 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:44:05.039849 27737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.033050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:38897 (local address 127.9.224.65:53045)
0619 04:44:05.034059 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:05.034074 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:05.034262 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:05.034635 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:05.034639 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:05.034699 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:05.035096 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:05.035110 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.036221 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.036228 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:05.037754 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:05.037767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.038989 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.038995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:05.039181 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.039207 (+ 26us) client_negotiation.cc:769] Sending connection context
0619 04:44:05.039318 (+ 111us) client_negotiation.cc:240] Negotiation successful
0619 04:44:05.039454 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":914,"thread_start_us":563,"threads_started":1}
I20260619 04:44:05.040020 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.032969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:35587 (local address 127.9.224.65:59955)
0619 04:44:05.034027 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:05.034052 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:05.034268 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:05.034985 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:05.034989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:05.035019 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:05.035434 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:05.035443 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.036428 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.036437 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:05.037893 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:05.037906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.039131 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.039137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:05.039298 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.039320 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 04:44:05.039424 (+ 104us) client_negotiation.cc:240] Negotiation successful
0619 04:44:05.039551 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":4,"spinlock_wait_cycles":46976,"thread_start_us":692,"threads_started":1}
I20260619 04:44:05.040328 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.033128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:59955 (local address 127.9.224.66:35587)
0619 04:44:05.033349 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:05.033358 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:05.034283 (+ 925us) server_negotiation.cc:407] Connection header received
0619 04:44:05.034778 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:05.034782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:05.034841 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:05.034918 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:05.035579 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.036282 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.038050 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.038904 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.039085 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.039164 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:05.039451 (+ 287us) server_negotiation.cc:299] Negotiation successful
0619 04:44:05.039622 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 04:44:05.041003 27664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0a7d0adc5e42eead6b0979cdab9bb5" candidate_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8353d9ecd92c45838418204b62b08cf7" is_pre_election: true
I20260619 04:44:05.041191 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0a7d0adc5e42eead6b0979cdab9bb5" candidate_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "091850a644f0443b9e1be5609dec2309" is_pre_election: true
I20260619 04:44:05.041642 27664 raft_consensus.cc:2454] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48b9440c0542a4b0bc6a2eba1e07ce in term 0.
I20260619 04:44:05.041716 27530 raft_consensus.cc:2454] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd48b9440c0542a4b0bc6a2eba1e07ce in term 0.
I20260619 04:44:05.042445 27329 leader_election.cc:302] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8353d9ecd92c45838418204b62b08cf7, fd48b9440c0542a4b0bc6a2eba1e07ce; no voters:
I20260619 04:44:05.042871 27735 raft_consensus.cc:2781] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:44:05.043035 27735 raft_consensus.cc:482] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:44:05.043192 27735 raft_consensus.cc:3037] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:05.045872 27735 raft_consensus.cc:504] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:05.046600 27735 leader_election.cc:288] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [CANDIDATE]: Term 1 election: Requested vote from peers 8353d9ecd92c45838418204b62b08cf7 (127.9.224.67:38897), 091850a644f0443b9e1be5609dec2309 (127.9.224.66:35587)
I20260619 04:44:05.047104 27664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0a7d0adc5e42eead6b0979cdab9bb5" candidate_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8353d9ecd92c45838418204b62b08cf7"
I20260619 04:44:05.047135 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0a7d0adc5e42eead6b0979cdab9bb5" candidate_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "091850a644f0443b9e1be5609dec2309"
I20260619 04:44:05.047333 27664 raft_consensus.cc:3037] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:05.047348 27530 raft_consensus.cc:3037] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:05.049592 27530 raft_consensus.cc:2454] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48b9440c0542a4b0bc6a2eba1e07ce in term 1.
I20260619 04:44:05.049647 27664 raft_consensus.cc:2454] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd48b9440c0542a4b0bc6a2eba1e07ce in term 1.
I20260619 04:44:05.050004 27330 leader_election.cc:302] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 091850a644f0443b9e1be5609dec2309, fd48b9440c0542a4b0bc6a2eba1e07ce; no voters:
I20260619 04:44:05.050379 27735 raft_consensus.cc:2781] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:05.050875 27735 raft_consensus.cc:686] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 1 LEADER]: Becoming Leader. State: Replica: fd48b9440c0542a4b0bc6a2eba1e07ce, State: Running, Role: LEADER
I20260619 04:44:05.051362 27735 consensus_queue.cc:237] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } }
I20260619 04:44:05.056298 27252 catalog_manager.cc:5495] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce reported cstate change: term changed from 0 to 1, leader changed from <none> to fd48b9440c0542a4b0bc6a2eba1e07ce (127.9.224.65). New cstate: current_term: 1 leader_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd48b9440c0542a4b0bc6a2eba1e07ce" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 33841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 } health_report { overall_health: UNKNOWN } } }
I20260619 04:44:05.117040 27727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.111423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55524 (local address 127.9.224.65:33841)
0619 04:44:05.111663 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:05.111668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:05.111687 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:44:05.111834 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:05.111837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:05.111914 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:05.112042 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:44:05.112401 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.113117 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.114875 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.115296 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.115400 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.115936 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:44:05.116498 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:44:05.116679 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:05.116756 (+ 77us) server_negotiation.cc:299] Negotiation successful
0619 04:44:05.116826 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:44:05.125506 27664 raft_consensus.cc:1261] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 1 FOLLOWER]: Refusing update from remote peer fd48b9440c0542a4b0bc6a2eba1e07ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:05.125506 27530 raft_consensus.cc:1261] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 1 FOLLOWER]: Refusing update from remote peer fd48b9440c0542a4b0bc6a2eba1e07ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:05.126550 27739 consensus_queue.cc:1035] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "091850a644f0443b9e1be5609dec2309" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:05.126905 27735 consensus_queue.cc:1035] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "8353d9ecd92c45838418204b62b08cf7" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 38897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:05.141763 27742 mvcc.cc:205] Tried to move back new op lower bound from 7298434028024463360 to 7298434027733880832. Current Snapshot: MvccSnapshot[applied={T|T < 7298434028024463360}]
I20260619 04:44:05.146004 27744 mvcc.cc:205] Tried to move back new op lower bound from 7298434028024463360 to 7298434027733880832. Current Snapshot: MvccSnapshot[applied={T|T < 7298434028024463360}]
I20260619 04:44:05.152071 27743 mvcc.cc:205] Tried to move back new op lower bound from 7298434028024463360 to 7298434027733880832. Current Snapshot: MvccSnapshot[applied={T|T < 7298434028024463360}]
I20260619 04:44:05.157656 27252 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:05.157943 27252 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:05.161819 27252 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe8367f0908c41928250e48dd17039ca: Sending DeleteTablet for 3 replicas of tablet 8a0a7d0adc5e42eead6b0979cdab9bb5
I20260619 04:44:05.162948 27644 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:05 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:60750
I20260619 04:44:05.163076 27376 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:05 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:55514
I20260619 04:44:05.163667 27510 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:05 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:32862
I20260619 04:44:05.166702 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27313
I20260619 04:44:05.173765 27754 tablet_replica.cc:330] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: stopping tablet replica
I20260619 04:44:05.174396 27754 raft_consensus.cc:2229] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:05.175033 27754 raft_consensus.cc:2258] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:05.176003 27753 tablet_replica.cc:330] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: stopping tablet replica
I20260619 04:44:05.176213 27752 tablet_replica.cc:330] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: stopping tablet replica
I20260619 04:44:05.176463 27753 raft_consensus.cc:2229] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:44:05.176692 27752 raft_consensus.cc:2229] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:05.177150 27753 raft_consensus.cc:2258] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:05.177237 27752 raft_consensus.cc:2258] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:05.179399 27753 ts_tablet_manager.cc:1905] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:05.179391 27752 ts_tablet_manager.cc:1905] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:05.181459 27754 ts_tablet_manager.cc:1905] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:05.186487 27752 ts_tablet_manager.cc:1918] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:05.186707 27752 log.cc:1196] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/8a0a7d0adc5e42eead6b0979cdab9bb5
I20260619 04:44:05.186746 27753 ts_tablet_manager.cc:1918] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:05.186909 27753 log.cc:1196] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/8a0a7d0adc5e42eead6b0979cdab9bb5
I20260619 04:44:05.187435 27752 ts_tablet_manager.cc:1939] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 8353d9ecd92c45838418204b62b08cf7: Deleting consensus metadata
I20260619 04:44:05.187446 27753 ts_tablet_manager.cc:1939] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P fd48b9440c0542a4b0bc6a2eba1e07ce: Deleting consensus metadata
I20260619 04:44:05.189260 27236 catalog_manager.cc:4841] TS 8353d9ecd92c45838418204b62b08cf7 (127.9.224.67:38897): tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 (table test-table [id=5d9fc88dde44426e9a95d1d0dee01795]) successfully deleted
I20260619 04:44:05.189594 27236 catalog_manager.cc:4841] TS fd48b9440c0542a4b0bc6a2eba1e07ce (127.9.224.65:33841): tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 (table test-table [id=5d9fc88dde44426e9a95d1d0dee01795]) successfully deleted
I20260619 04:44:05.191504 27754 ts_tablet_manager.cc:1918] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:05.191699 27754 log.cc:1196] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/8a0a7d0adc5e42eead6b0979cdab9bb5
I20260619 04:44:05.192305 27754 ts_tablet_manager.cc:1939] T 8a0a7d0adc5e42eead6b0979cdab9bb5 P 091850a644f0443b9e1be5609dec2309: Deleting consensus metadata
I20260619 04:44:05.194103 27237 catalog_manager.cc:4841] TS 091850a644f0443b9e1be5609dec2309 (127.9.224.66:35587): tablet 8a0a7d0adc5e42eead6b0979cdab9bb5 (table test-table [id=5d9fc88dde44426e9a95d1d0dee01795]) successfully deleted
Jun 19 04:44:05 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:44:05.205940 27727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.168575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.9.224.65:33841)
0619 04:44:05.168760 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:05.168766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:05.188186 (+ 19420us) server_negotiation.cc:407] Connection header received
0619 04:44:05.188694 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:05.188700 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:05.188807 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:05.188881 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:05.191973 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.193191 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.195084 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.195526 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.195676 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.199735 (+ 4059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:05.199748 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:05.199800 (+ 52us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:05.199851 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:05.203097 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:05.203785 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:05.203797 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:05.203799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:05.203943 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:05.204325 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:05.204329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:05.204331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:05.204673 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:05.204982 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:05.205310 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 04:44:05.205557 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:44:05.206676 27436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:05.305823 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27313
I20260619 04:44:05.324854 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27447
Jun 19 04:44:05 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:44:05.340313 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.325563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32878 (local address 127.9.224.66:35587)
0619 04:44:05.325757 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:05.325765 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:05.325785 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:44:05.325998 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:05.326003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:05.326093 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:05.326205 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:05.327515 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.328281 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.329642 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.330052 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.330196 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.334601 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:05.334615 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:05.334631 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:05.334667 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:05.337384 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:05.338097 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:05.338104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:05.338106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:05.338291 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:05.338681 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:05.338686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:05.338689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:05.339084 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:05.339395 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:05.339710 (+ 315us) server_negotiation.cc:299] Negotiation successful
0619 04:44:05.339947 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:44:05.341007 27570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:05.432348 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27447
I20260619 04:44:05.449506 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27581
Jun 19 04:44:05 dist-test-slave-9dgf krb5kdc[27207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:44:05.465193 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:05.450435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60752 (local address 127.9.224.67:38897)
0619 04:44:05.450648 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:05.450653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:05.450671 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:44:05.450783 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:05.450787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:05.450859 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:05.450953 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:05.452283 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.453004 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.454342 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:05.454767 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:05.454858 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:05.459655 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:05.459672 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:05.459689 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:05.459725 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:05.462539 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:05.463282 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:05.463289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:05.463292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:05.463425 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:05.463811 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:05.463814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:05.463816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:05.464197 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:05.464421 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:05.464743 (+ 322us) server_negotiation.cc:299] Negotiation successful
0619 04:44:05.464912 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:44:05.465870 27704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:05.555300 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27581
I20260619 04:44:05.572501 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27220
I20260619 04:44:05.573773 27282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:05.686916 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27220
2026-06-19T04:44:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4611 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-06-19T04:44:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:05Z Disabled control of system clock
I20260619 04:44:05.768313 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46047
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 04:44:06.106878 27763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:06.107170 27763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:06.107342 27763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:06.114792 27763 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:06.114900 27763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:06.114993 27763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:06.115097 27763 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:06.115165 27763 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:06.124480 27763 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46047
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:06.125842 27763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:06.127678 27763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:06.139688 27769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:06.139724 27768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:06.139767 27771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:06.140384 27763 server_base.cc:1034] running on GCE node
I20260619 04:44:06.141290 27763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:06.142917 27763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:06.144151 27763 hybrid_clock.cc:648] HybridClock initialized: now 1781844246144099 us; error 44 us; skew 500 ppm
I20260619 04:44:06.144518 27763 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:06.153611 27763 webserver.cc:460] Webserver started at http://127.9.224.126:44435/ using document root <none> and password file <none>
I20260619 04:44:06.154466 27763 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:06.154628 27763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:06.154965 27763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:06.157955 27763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "de864dc79753401fb4f5c5b7b7dd0c15"
format_stamp: "Formatted at 2026-06-19 04:44:06 on dist-test-slave-9dgf"
server_key: "eaae07759e32f028dba56d98b2c26c4f"
server_key_iv: "0f41f74752d6f9d65065213cb9c209c8"
server_key_version: "encryptionkey@0"
I20260619 04:44:06.158931 27763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "de864dc79753401fb4f5c5b7b7dd0c15"
format_stamp: "Formatted at 2026-06-19 04:44:06 on dist-test-slave-9dgf"
server_key: "eaae07759e32f028dba56d98b2c26c4f"
server_key_iv: "0f41f74752d6f9d65065213cb9c209c8"
server_key_version: "encryptionkey@0"
I20260619 04:44:06.164757 27763 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:06.168368 27777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:06.169847 27763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:44:06.170044 27763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "de864dc79753401fb4f5c5b7b7dd0c15"
format_stamp: "Formatted at 2026-06-19 04:44:06 on dist-test-slave-9dgf"
server_key: "eaae07759e32f028dba56d98b2c26c4f"
server_key_iv: "0f41f74752d6f9d65065213cb9c209c8"
server_key_version: "encryptionkey@0"
I20260619 04:44:06.170292 27763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:06.186970 27763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:06.187863 27763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:06.188163 27763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:06.206719 27763 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:46047
I20260619 04:44:06.206740 27828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:46047 every 8 connection(s)
I20260619 04:44:06.208105 27763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:06.211971 27829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:06.213577 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27763
I20260619 04:44:06.213771 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:06.214411 10113 external_mini_cluster.cc:1428] Setting key c0842d5fb418da02f18f47b298e84665
I20260619 04:44:06.224689 27829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15: Bootstrap starting.
I20260619 04:44:06.228575 27829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:06.229740 27832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:06.216479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.9.224.126:46047)
0619 04:44:06.217694 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:06.217705 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:06.217753 (+ 48us) server_negotiation.cc:407] Connection header received
0619 04:44:06.219841 (+ 2088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:06.219866 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:06.220396 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:06.220776 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:06.221416 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:06.223045 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:06.224935 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:06.225738 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:06.225880 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:06.227350 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:06.227358 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:06.227372 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:06.227918 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:06.228012 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:06.228033 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:06.228134 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:06.228357 (+ 223us) server_negotiation.cc:299] Negotiation successful
0619 04:44:06.228714 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765,"thread_start_us":447,"threads_started":1}
I20260619 04:44:06.229745 27829 log.cc:824] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:06.232956 27829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15: No bootstrap required, opened a new log
I20260619 04:44:06.240769 27829 raft_consensus.cc:348] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46047 } }
I20260619 04:44:06.241256 27829 raft_consensus.cc:374] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:06.241364 27829 raft_consensus.cc:729] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de864dc79753401fb4f5c5b7b7dd0c15, State: Initialized, Role: FOLLOWER
I20260619 04:44:06.241957 27829 consensus_queue.cc:260] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46047 } }
I20260619 04:44:06.242205 27829 raft_consensus.cc:388] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:06.242362 27829 raft_consensus.cc:482] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:06.242542 27829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:06.244874 27829 raft_consensus.cc:504] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46047 } }
I20260619 04:44:06.245456 27829 leader_election.cc:302] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de864dc79753401fb4f5c5b7b7dd0c15; no voters:
I20260619 04:44:06.246075 27829 leader_election.cc:288] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:06.246284 27834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:06.247115 27834 raft_consensus.cc:686] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [term 1 LEADER]: Becoming Leader. State: Replica: de864dc79753401fb4f5c5b7b7dd0c15, State: Running, Role: LEADER
I20260619 04:44:06.247614 27834 consensus_queue.cc:237] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46047 } }
I20260619 04:44:06.248386 27829 sys_catalog.cc:564] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:06.250645 27836 sys_catalog.cc:455] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de864dc79753401fb4f5c5b7b7dd0c15. Latest consensus state: current_term: 1 leader_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46047 } } }
I20260619 04:44:06.251155 27836 sys_catalog.cc:458] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:06.251716 27835 sys_catalog.cc:455] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de864dc79753401fb4f5c5b7b7dd0c15" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46047 } } }
I20260619 04:44:06.252094 27835 sys_catalog.cc:458] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:06.253479 27843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:06.259295 27843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:06.267901 27843 catalog_manager.cc:1347] Generated new cluster ID: 59fe592c02c54360afa2f92a8fd9618e
I20260619 04:44:06.268025 27843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:06.291309 27843 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:06.293220 27843 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:06.308794 27843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15: Generated new TSK 0
I20260619 04:44:06.309926 27843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:06.322728 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46047
--builtin_ntp_servers=127.9.224.84:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 04:44:06.671623 27853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:06.671993 27853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:06.672160 27853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:06.680024 27853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:06.680179 27853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:06.680365 27853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:44:06.689612 27853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:06.691035 27853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:06.692982 27853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:06.706255 27861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:06.706218 27858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:06.706365 27859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:06.711113 27853 server_base.cc:1034] running on GCE node
I20260619 04:44:06.711973 27853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:06.713093 27853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:06.714372 27853 hybrid_clock.cc:648] HybridClock initialized: now 1781844246714315 us; error 42 us; skew 500 ppm
I20260619 04:44:06.714763 27853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:06.717278 27853 webserver.cc:460] Webserver started at http://127.9.224.65:46779/ using document root <none> and password file <none>
I20260619 04:44:06.718118 27853 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:06.718298 27853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:06.718744 27853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:06.722072 27853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "e56f3881843e48bdb896957671dc6d73"
format_stamp: "Formatted at 2026-06-19 04:44:06 on dist-test-slave-9dgf"
server_key: "b719b4656d6c9b07a3ba7c70da21a040"
server_key_iv: "6ff3534b3dc7e43c3a01a056738738cb"
server_key_version: "encryptionkey@0"
I20260619 04:44:06.723104 27853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "e56f3881843e48bdb896957671dc6d73"
format_stamp: "Formatted at 2026-06-19 04:44:06 on dist-test-slave-9dgf"
server_key: "b719b4656d6c9b07a3ba7c70da21a040"
server_key_iv: "6ff3534b3dc7e43c3a01a056738738cb"
server_key_version: "encryptionkey@0"
I20260619 04:44:06.729318 27853 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260619 04:44:06.733927 27867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:06.735694 27853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:06.735837 27853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "e56f3881843e48bdb896957671dc6d73"
format_stamp: "Formatted at 2026-06-19 04:44:06 on dist-test-slave-9dgf"
server_key: "b719b4656d6c9b07a3ba7c70da21a040"
server_key_iv: "6ff3534b3dc7e43c3a01a056738738cb"
server_key_version: "encryptionkey@0"
I20260619 04:44:06.736047 27853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:06.774955 27853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:06.775924 27853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:06.776216 27853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:06.777256 27853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:06.778909 27853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:06.779004 27853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:06.779121 27853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:06.779208 27853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:06.817329 27853 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:40109
I20260619 04:44:06.817438 27979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:40109 every 8 connection(s)
I20260619 04:44:06.818898 27853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:44:06.821729 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27853
I20260619 04:44:06.821939 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:44:06.826327 10113 external_mini_cluster.cc:1428] Setting key 9d339e4f4746b12d8990565af00b8a6a
I20260619 04:44:06.829319 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46047
--builtin_ntp_servers=127.9.224.84:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 04:44:06.833989 27982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:06.821852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:50145 (local address 127.9.224.126:46047)
0619 04:44:06.822466 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:06.822474 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:06.823993 (+ 1519us) server_negotiation.cc:407] Connection header received
0619 04:44:06.825966 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:06.825974 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:06.826062 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:06.826208 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:06.827744 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:06.828671 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:06.830534 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:06.831290 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:06.831437 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:06.832933 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:06.832942 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:06.832949 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:06.832976 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:06.833027 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:06.833046 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:06.833146 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:06.833437 (+ 291us) server_negotiation.cc:299] Negotiation successful
0619 04:44:06.833549 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":307,"threads_started":1}
I20260619 04:44:06.834949 27983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:06.822630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46047 (local address 127.9.224.65:50145)
0619 04:44:06.823802 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:06.823859 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:06.825674 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:06.826588 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:06.826598 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:06.826699 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:06.827528 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:06.827585 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:06.828853 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:06.828857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:06.830385 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:06.830401 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:06.831536 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:06.831541 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:06.831765 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:06.832530 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:06.832533 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:06.832620 (+ 87us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:06.832705 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:06.833198 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:06.833208 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:06.833215 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 04:44:06.833378 (+ 163us) client_negotiation.cc:240] Negotiation successful
0619 04:44:06.833736 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":363,"threads_started":1}
I20260619 04:44:06.836663 27980 heartbeater.cc:347] Connected to a master server at 127.9.224.126:46047
I20260619 04:44:06.836997 27980 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:06.837812 27980 heartbeater.cc:511] Master 127.9.224.126:46047 requested a full tablet report, sending...
I20260619 04:44:06.840194 27794 ts_manager.cc:194] Registered new tserver with Master: e56f3881843e48bdb896957671dc6d73 (127.9.224.65:40109)
I20260619 04:44:06.842486 27794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.65:50145
W20260619 04:44:07.163522 27984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:07.163836 27984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:07.163930 27984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:07.171458 27984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:07.171584 27984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:07.171694 27984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:44:07.181301 27984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:07.182687 27984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:07.184432 27984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:07.197796 27989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:07.197768 27990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:07.198060 27992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:07.198678 27984 server_base.cc:1034] running on GCE node
I20260619 04:44:07.199292 27984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:07.200214 27984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:07.201426 27984 hybrid_clock.cc:648] HybridClock initialized: now 1781844247201352 us; error 58 us; skew 500 ppm
I20260619 04:44:07.201716 27984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:07.204192 27984 webserver.cc:460] Webserver started at http://127.9.224.66:33309/ using document root <none> and password file <none>
I20260619 04:44:07.204877 27984 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:07.204962 27984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:07.205237 27984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:07.208207 27984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "cfb205e1a5b64de0ac35a84d9058e9f7"
format_stamp: "Formatted at 2026-06-19 04:44:07 on dist-test-slave-9dgf"
server_key: "c151be854d9a59c3fcd3f7c63ae764a8"
server_key_iv: "033b29559113d92a8fef9e255b3f645b"
server_key_version: "encryptionkey@0"
I20260619 04:44:07.209026 27984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "cfb205e1a5b64de0ac35a84d9058e9f7"
format_stamp: "Formatted at 2026-06-19 04:44:07 on dist-test-slave-9dgf"
server_key: "c151be854d9a59c3fcd3f7c63ae764a8"
server_key_iv: "033b29559113d92a8fef9e255b3f645b"
server_key_version: "encryptionkey@0"
I20260619 04:44:07.214596 27984 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 04:44:07.218418 27998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:07.219900 27984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:07.220109 27984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "cfb205e1a5b64de0ac35a84d9058e9f7"
format_stamp: "Formatted at 2026-06-19 04:44:07 on dist-test-slave-9dgf"
server_key: "c151be854d9a59c3fcd3f7c63ae764a8"
server_key_iv: "033b29559113d92a8fef9e255b3f645b"
server_key_version: "encryptionkey@0"
I20260619 04:44:07.220352 27984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:07.259018 27984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:07.259986 27984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:07.260416 27984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:07.261704 27984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:07.263336 27984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:07.263468 27984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:07.263612 27984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:07.263727 27984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:07.299860 27984 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:39563
I20260619 04:44:07.299954 28110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:39563 every 8 connection(s)
I20260619 04:44:07.301335 27984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:44:07.308274 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 27984
I20260619 04:44:07.308491 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:44:07.309078 10113 external_mini_cluster.cc:1428] Setting key eb7b94af67b073e9d6f9ddec10cd4e82
I20260619 04:44:07.312285 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46047
--builtin_ntp_servers=127.9.224.84:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 04:44:07.316100 27982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.304145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:48867 (local address 127.9.224.126:46047)
0619 04:44:07.304347 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.304352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.305766 (+ 1414us) server_negotiation.cc:407] Connection header received
0619 04:44:07.307588 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.307593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.307667 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.307766 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:07.309362 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.310303 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.312712 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.313457 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.313637 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.315164 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:07.315173 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:07.315180 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:07.315205 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:07.315248 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:07.315266 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:07.315361 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.315584 (+ 223us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.315705 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 04:44:07.317054 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.304678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46047 (local address 127.9.224.66:48867)
0619 04:44:07.305596 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.305632 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.307337 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.308119 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.308130 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.308255 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:07.309149 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.309177 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.310475 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.310480 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.312463 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.312480 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.313692 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.313697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.313925 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.314809 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:07.314812 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:07.314854 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:07.314940 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:07.315370 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:07.315378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:07.315384 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.315532 (+ 148us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.315869 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":275,"threads_started":1}
I20260619 04:44:07.318753 28111 heartbeater.cc:347] Connected to a master server at 127.9.224.126:46047
I20260619 04:44:07.319119 28111 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:07.320063 28111 heartbeater.cc:511] Master 127.9.224.126:46047 requested a full tablet report, sending...
I20260619 04:44:07.321941 27794 ts_manager.cc:194] Registered new tserver with Master: cfb205e1a5b64de0ac35a84d9058e9f7 (127.9.224.66:39563)
I20260619 04:44:07.323233 27794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.66:48867
W20260619 04:44:07.643409 28114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:07.643739 28114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:07.643831 28114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:07.651268 28114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:07.651396 28114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:07.651575 28114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:44:07.660970 28114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:46047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:07.662456 28114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:07.664228 28114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:07.677762 28120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:07.677874 28122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:07.677850 28119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:07.678934 28114 server_base.cc:1034] running on GCE node
I20260619 04:44:07.679595 28114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:07.680610 28114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:07.681867 28114 hybrid_clock.cc:648] HybridClock initialized: now 1781844247681818 us; error 60 us; skew 500 ppm
I20260619 04:44:07.682303 28114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:07.684648 28114 webserver.cc:460] Webserver started at http://127.9.224.67:45497/ using document root <none> and password file <none>
I20260619 04:44:07.685382 28114 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:07.685519 28114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:07.685848 28114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:07.688902 28114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "ba45121c65094a7580aab2b55671af8c"
format_stamp: "Formatted at 2026-06-19 04:44:07 on dist-test-slave-9dgf"
server_key: "6601b5183587092e7e2cc702f59b5653"
server_key_iv: "36c2d3f747fbd2a9c8c3a3e4cc38d329"
server_key_version: "encryptionkey@0"
I20260619 04:44:07.689741 28114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "ba45121c65094a7580aab2b55671af8c"
format_stamp: "Formatted at 2026-06-19 04:44:07 on dist-test-slave-9dgf"
server_key: "6601b5183587092e7e2cc702f59b5653"
server_key_iv: "36c2d3f747fbd2a9c8c3a3e4cc38d329"
server_key_version: "encryptionkey@0"
I20260619 04:44:07.695179 28114 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 04:44:07.698997 28128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:07.700450 28114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:07.700649 28114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "ba45121c65094a7580aab2b55671af8c"
format_stamp: "Formatted at 2026-06-19 04:44:07 on dist-test-slave-9dgf"
server_key: "6601b5183587092e7e2cc702f59b5653"
server_key_iv: "36c2d3f747fbd2a9c8c3a3e4cc38d329"
server_key_version: "encryptionkey@0"
I20260619 04:44:07.700886 28114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:07.723278 28114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:07.724216 28114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:07.724525 28114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:07.725577 28114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:07.727164 28114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:07.727289 28114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:07.727430 28114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:07.727516 28114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:07.765555 28114 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:35703
I20260619 04:44:07.765648 28240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:35703 every 8 connection(s)
I20260619 04:44:07.766927 28114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:44:07.770040 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28114
I20260619 04:44:07.770279 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:44:07.770874 10113 external_mini_cluster.cc:1428] Setting key 4c2b9f321fad23045406ed28dfb17c79
I20260619 04:44:07.781036 27982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.769744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:58329 (local address 127.9.224.126:46047)
0619 04:44:07.769927 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.769931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.771803 (+ 1872us) server_negotiation.cc:407] Connection header received
0619 04:44:07.774471 (+ 2668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.774476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.774570 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.774685 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:07.775782 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.776552 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.778134 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.778615 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.778766 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.780185 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:07.780197 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:07.780202 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:07.780228 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:07.780259 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:07.780271 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:07.780372 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.780602 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.780707 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:44:07.782351 28243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.770483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46047 (local address 127.9.224.67:58329)
0619 04:44:07.771627 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.771684 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.774134 (+ 2450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.774930 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.774938 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.775032 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:07.775614 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.775631 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.776695 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.776701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.777978 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.777990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.778852 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.778861 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.779123 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.779847 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:07.779850 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:07.779892 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:07.779979 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:07.780371 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:07.780384 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:07.780395 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.780592 (+ 197us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.781034 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":341,"threads_started":1}
I20260619 04:44:07.783849 28241 heartbeater.cc:347] Connected to a master server at 127.9.224.126:46047
I20260619 04:44:07.784214 28241 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:07.785255 28241 heartbeater.cc:511] Master 127.9.224.126:46047 requested a full tablet report, sending...
I20260619 04:44:07.787104 27793 ts_manager.cc:194] Registered new tserver with Master: ba45121c65094a7580aab2b55671af8c (127.9.224.67:35703)
I20260619 04:44:07.788009 27793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.67:58329
I20260619 04:44:07.799840 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:44:07.810962 27982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.804403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36632 (local address 127.9.224.126:46047)
0619 04:44:07.804663 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.804673 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.805073 (+ 400us) server_negotiation.cc:407] Connection header received
0619 04:44:07.805253 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.805257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.805326 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.805483 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:07.806000 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.806966 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.808359 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.808885 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.808994 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.810101 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:07.810107 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:07.810110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:07.810128 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:07.810162 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:07.810175 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:07.810356 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.810499 (+ 143us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.810578 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:44:07.815074 27793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:44:07.824523 27793 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:44:07.845813 27980 heartbeater.cc:503] Master 127.9.224.126:46047 was elected leader, sending a full tablet report...
I20260619 04:44:07.867637 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.838407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:35703 (local address 127.0.0.1:56968)
0619 04:44:07.852138 (+ 13731us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.852197 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.852472 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.856868 (+ 4396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.856881 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.856929 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:07.857428 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.857448 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.860158 (+ 2710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.860167 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.864469 (+ 4302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.864485 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.866533 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.866539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.866830 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.866887 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.867022 (+ 135us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.867259 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12803,"mutex_wait_us":259,"thread_start_us":17453,"threads_started":1}
I20260619 04:44:07.867663 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.838682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56968 (local address 127.9.224.67:35703)
0619 04:44:07.855713 (+ 17031us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.855725 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.855774 (+ 49us) server_negotiation.cc:407] Connection header received
0619 04:44:07.855909 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.855923 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.856298 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.857720 (+ 1422us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:07.858096 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.859976 (+ 1880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.864951 (+ 4975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.866163 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.866302 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.866635 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.867099 (+ 464us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.867292 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16759,"thread_start_us":17819,"threads_started":1}
I20260619 04:44:07.869046 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.838748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:39563 (local address 127.0.0.1:40262)
0619 04:44:07.855602 (+ 16854us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.855624 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.855759 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.860402 (+ 4643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.860408 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.860434 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:07.860933 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.860952 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.863490 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.863497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.866121 (+ 2624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.866140 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.868112 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.868118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.868314 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.868359 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.868449 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.868603 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16719,"mutex_wait_us":6,"thread_start_us":12284,"threads_started":1}
I20260619 04:44:07.869125 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.839151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40262 (local address 127.9.224.66:39563)
0619 04:44:07.859655 (+ 20504us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.859664 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.859696 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:44:07.859801 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.859809 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.860091 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.860285 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:07.861192 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.863274 (+ 2082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.866416 (+ 3142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.867924 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.868050 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.868333 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.868618 (+ 285us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.868802 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20319,"thread_start_us":20938,"threads_started":1}
I20260619 04:44:07.872247 28176 tablet_service.cc:1467] Processing CreateTablet for tablet b1b0ca9ee1974466b2891d05a17d6cd4 (DEFAULT_TABLE table=test-table [id=12a74e56e24540f4a373a0ed09172ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:07.872949 28046 tablet_service.cc:1467] Processing CreateTablet for tablet b1b0ca9ee1974466b2891d05a17d6cd4 (DEFAULT_TABLE table=test-table [id=12a74e56e24540f4a373a0ed09172ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:07.873754 28176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b0ca9ee1974466b2891d05a17d6cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:07.874140 28046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b0ca9ee1974466b2891d05a17d6cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:07.883812 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.860636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45522)
0619 04:44:07.865057 (+ 4421us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.865079 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.865198 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.865957 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.865962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.865993 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:07.866511 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.866524 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.868376 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.868380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.880562 (+ 12182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.880588 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.882929 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.882936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.883136 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.883175 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.883268 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.883422 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4275,"mutex_wait_us":24,"thread_start_us":5527,"threads_started":1}
I20260619 04:44:07.884131 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.856648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45522 (local address 127.9.224.65:40109)
0619 04:44:07.863950 (+ 7302us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.863960 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.865327 (+ 1367us) server_negotiation.cc:407] Connection header received
0619 04:44:07.865435 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.865443 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.865741 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.865945 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:07.866748 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.868219 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.880912 (+ 12693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.882692 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.882849 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.883135 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.883367 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.883556 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7108,"thread_start_us":6949,"threads_started":1}
I20260619 04:44:07.885936 28259 tablet_bootstrap.cc:492] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Bootstrap starting.
I20260619 04:44:07.886067 28260 tablet_bootstrap.cc:492] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Bootstrap starting.
I20260619 04:44:07.888536 27915 tablet_service.cc:1467] Processing CreateTablet for tablet b1b0ca9ee1974466b2891d05a17d6cd4 (DEFAULT_TABLE table=test-table [id=12a74e56e24540f4a373a0ed09172ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:07.889859 28260 tablet_bootstrap.cc:654] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:07.889890 28259 tablet_bootstrap.cc:654] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:07.890164 27915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b0ca9ee1974466b2891d05a17d6cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:07.891026 28259 log.cc:824] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:07.891091 28260 log.cc:824] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:07.895545 28259 tablet_bootstrap.cc:492] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: No bootstrap required, opened a new log
I20260619 04:44:07.895542 28260 tablet_bootstrap.cc:492] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: No bootstrap required, opened a new log
I20260619 04:44:07.895836 28260 ts_tablet_manager.cc:1397] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 04:44:07.895838 28259 ts_tablet_manager.cc:1397] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260619 04:44:07.902411 28263 tablet_bootstrap.cc:492] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: Bootstrap starting.
I20260619 04:44:07.906184 28263 tablet_bootstrap.cc:654] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:07.906895 28260 raft_consensus.cc:348] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.907279 28263 log.cc:824] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:07.907368 28260 raft_consensus.cc:374] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:07.907095 28259 raft_consensus.cc:348] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.907507 28259 raft_consensus.cc:374] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:07.907526 28260 raft_consensus.cc:729] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba45121c65094a7580aab2b55671af8c, State: Initialized, Role: FOLLOWER
I20260619 04:44:07.907610 28259 raft_consensus.cc:729] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfb205e1a5b64de0ac35a84d9058e9f7, State: Initialized, Role: FOLLOWER
I20260619 04:44:07.908190 28259 consensus_queue.cc:260] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.908190 28260 consensus_queue.cc:260] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.910286 28260 ts_tablet_manager.cc:1428] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260619 04:44:07.910542 28263 tablet_bootstrap.cc:492] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: No bootstrap required, opened a new log
I20260619 04:44:07.910840 28263 ts_tablet_manager.cc:1397] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 04:44:07.910835 28241 heartbeater.cc:503] Master 127.9.224.126:46047 was elected leader, sending a full tablet report...
I20260619 04:44:07.911598 28259 ts_tablet_manager.cc:1428] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Time spent starting tablet: real 0.016s user 0.009s sys 0.007s
I20260619 04:44:07.912011 28111 heartbeater.cc:503] Master 127.9.224.126:46047 was elected leader, sending a full tablet report...
I20260619 04:44:07.919574 28263 raft_consensus.cc:348] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.919965 28263 raft_consensus.cc:374] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:07.920035 28263 raft_consensus.cc:729] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56f3881843e48bdb896957671dc6d73, State: Initialized, Role: FOLLOWER
I20260619 04:44:07.920449 28265 raft_consensus.cc:482] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:07.920745 28263 consensus_queue.cc:260] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.920732 28265 raft_consensus.cc:504] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.922727 28263 ts_tablet_manager.cc:1428] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260619 04:44:07.923204 28265 leader_election.cc:288] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba45121c65094a7580aab2b55671af8c (127.9.224.67:35703), e56f3881843e48bdb896957671dc6d73 (127.9.224.65:40109)
I20260619 04:44:07.930874 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.923564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:47585 (local address 127.9.224.67:35703)
0619 04:44:07.923820 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.923829 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.924311 (+ 482us) server_negotiation.cc:407] Connection header received
0619 04:44:07.924597 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.924602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.924700 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.924792 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:07.925663 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.926785 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.928832 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.929871 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.929991 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.930039 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.930435 (+ 396us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.930590 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 04:44:07.930915 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.923490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:35703 (local address 127.9.224.66:47585)
0619 04:44:07.924198 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.924223 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.924428 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.925030 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.925037 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.925068 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:07.925503 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.925514 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.926919 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.926924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.928630 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.928642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.930061 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.930067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.930280 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.930322 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.930416 (+ 94us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.930559 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":19,"thread_start_us":361,"threads_started":1}
I20260619 04:44:07.931358 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.924536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:33211 (local address 127.9.224.65:40109)
0619 04:44:07.924703 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.924709 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.925441 (+ 732us) server_negotiation.cc:407] Connection header received
0619 04:44:07.925603 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.925608 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.925690 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.925813 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:07.926402 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.927463 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.929413 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.930418 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.930557 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.930615 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.930967 (+ 352us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.931103 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 04:44:07.931682 28269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.924263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.9.224.66:33211)
0619 04:44:07.925322 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:07.925352 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:07.925491 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:07.925828 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:07.925832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:07.925856 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:07.926148 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.926156 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.927618 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.927622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.929237 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:07.929253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.930598 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.930604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:07.930783 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.930813 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 04:44:07.930924 (+ 111us) client_negotiation.cc:240] Negotiation successful
0619 04:44:07.931258 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"mutex_wait_us":2,"thread_start_us":702,"threads_started":1}
I20260619 04:44:07.932220 28196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b0ca9ee1974466b2891d05a17d6cd4" candidate_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba45121c65094a7580aab2b55671af8c" is_pre_election: true
I20260619 04:44:07.932631 27935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b0ca9ee1974466b2891d05a17d6cd4" candidate_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56f3881843e48bdb896957671dc6d73" is_pre_election: true
I20260619 04:44:07.932839 28196 raft_consensus.cc:2454] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfb205e1a5b64de0ac35a84d9058e9f7 in term 0.
I20260619 04:44:07.933167 27935 raft_consensus.cc:2454] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfb205e1a5b64de0ac35a84d9058e9f7 in term 0.
I20260619 04:44:07.933604 28002 leader_election.cc:302] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba45121c65094a7580aab2b55671af8c, cfb205e1a5b64de0ac35a84d9058e9f7; no voters:
I20260619 04:44:07.933974 28265 raft_consensus.cc:2781] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:44:07.934130 28265 raft_consensus.cc:482] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:44:07.934288 28265 raft_consensus.cc:3037] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:07.936460 28265 raft_consensus.cc:504] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.937024 28265 leader_election.cc:288] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [CANDIDATE]: Term 1 election: Requested vote from peers ba45121c65094a7580aab2b55671af8c (127.9.224.67:35703), e56f3881843e48bdb896957671dc6d73 (127.9.224.65:40109)
I20260619 04:44:07.937529 28196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b0ca9ee1974466b2891d05a17d6cd4" candidate_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba45121c65094a7580aab2b55671af8c"
I20260619 04:44:07.937654 27935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b0ca9ee1974466b2891d05a17d6cd4" candidate_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e56f3881843e48bdb896957671dc6d73"
I20260619 04:44:07.937757 28196 raft_consensus.cc:3037] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:07.937908 27935 raft_consensus.cc:3037] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:07.941134 27935 raft_consensus.cc:2454] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfb205e1a5b64de0ac35a84d9058e9f7 in term 1.
I20260619 04:44:07.941134 28196 raft_consensus.cc:2454] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfb205e1a5b64de0ac35a84d9058e9f7 in term 1.
I20260619 04:44:07.941540 28002 leader_election.cc:302] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfb205e1a5b64de0ac35a84d9058e9f7, e56f3881843e48bdb896957671dc6d73; no voters:
I20260619 04:44:07.941859 28265 raft_consensus.cc:2781] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:07.942409 28265 raft_consensus.cc:686] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 1 LEADER]: Becoming Leader. State: Replica: cfb205e1a5b64de0ac35a84d9058e9f7, State: Running, Role: LEADER
I20260619 04:44:07.943061 28265 consensus_queue.cc:237] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } }
I20260619 04:44:07.947655 27793 catalog_manager.cc:5495] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfb205e1a5b64de0ac35a84d9058e9f7 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfb205e1a5b64de0ac35a84d9058e9f7" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 } health_report { overall_health: UNKNOWN } } }
I20260619 04:44:07.978339 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:07.973080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40278 (local address 127.9.224.66:39563)
0619 04:44:07.973274 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:07.973278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:07.973297 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:44:07.973461 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:07.973465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:07.973553 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:07.973706 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:44:07.974057 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.974801 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.976183 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:07.976597 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:07.976694 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:07.977141 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:44:07.977676 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:44:07.977806 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:07.977902 (+ 96us) server_negotiation.cc:299] Negotiation successful
0619 04:44:07.977967 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:44:07.986658 27935 raft_consensus.cc:1261] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 1 FOLLOWER]: Refusing update from remote peer cfb205e1a5b64de0ac35a84d9058e9f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:07.986658 28196 raft_consensus.cc:1261] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 1 FOLLOWER]: Refusing update from remote peer cfb205e1a5b64de0ac35a84d9058e9f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:07.987690 28270 consensus_queue.cc:1035] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e56f3881843e48bdb896957671dc6d73" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:07.988039 28265 consensus_queue.cc:1035] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba45121c65094a7580aab2b55671af8c" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:07.999931 28273 mvcc.cc:205] Tried to move back new op lower bound from 7298434039742742528 to 7298434039579033600. Current Snapshot: MvccSnapshot[applied={T|T < 7298434039742742528}]
I20260619 04:44:08.021878 27794 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:08.022163 27794 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:08.025812 27794 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de864dc79753401fb4f5c5b7b7dd0c15: Sending DeleteTablet for 3 replicas of tablet b1b0ca9ee1974466b2891d05a17d6cd4
I20260619 04:44:08.027091 28046 tablet_service.cc:1514] Processing DeleteTablet for tablet b1b0ca9ee1974466b2891d05a17d6cd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:08 UTC) from {username='slave'} at 127.0.0.1:40262
I20260619 04:44:08.027136 28176 tablet_service.cc:1514] Processing DeleteTablet for tablet b1b0ca9ee1974466b2891d05a17d6cd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:08 UTC) from {username='slave'} at 127.0.0.1:56968
I20260619 04:44:08.027765 27915 tablet_service.cc:1514] Processing DeleteTablet for tablet b1b0ca9ee1974466b2891d05a17d6cd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:08 UTC) from {username='slave'} at 127.0.0.1:45522
I20260619 04:44:08.029664 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27853
I20260619 04:44:08.037941 28285 tablet_replica.cc:330] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73: stopping tablet replica
I20260619 04:44:08.039012 28284 tablet_replica.cc:330] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: stopping tablet replica
I20260619 04:44:08.039503 28284 raft_consensus.cc:2229] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:08.039880 28285 raft_consensus.cc:2229] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:08.040124 28284 raft_consensus.cc:2258] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:08.040908 28283 tablet_replica.cc:330] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: stopping tablet replica
I20260619 04:44:08.041343 28283 raft_consensus.cc:2229] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:44:08.042079 28283 raft_consensus.cc:2258] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:08.042780 28284 ts_tablet_manager.cc:1905] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:08.042834 28285 raft_consensus.cc:2258] T b1b0ca9ee1974466b2891d05a17d6cd4 P e56f3881843e48bdb896957671dc6d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:08.046150 28283 ts_tablet_manager.cc:1905] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:08.047092 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.031091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45532 (local address 127.9.224.65:40109)
0619 04:44:08.031275 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:08.031283 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:08.038199 (+ 6916us) server_negotiation.cc:407] Connection header received
0619 04:44:08.038496 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:08.038503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:08.038619 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:08.038739 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:08.039420 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:08.040614 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:08.042634 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:08.043365 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:08.043465 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:08.045041 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:08.045052 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:08.045078 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:08.045818 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:08.045879 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:08.045906 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:08.046018 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:08.046613 (+ 595us) server_negotiation.cc:299] Negotiation successful
0619 04:44:08.046731 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:44:08.047950 27975 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:08.055851 28283 ts_tablet_manager.cc:1918] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:08.056064 28283 log.cc:1196] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b1b0ca9ee1974466b2891d05a17d6cd4
I20260619 04:44:08.056921 28283 ts_tablet_manager.cc:1939] T b1b0ca9ee1974466b2891d05a17d6cd4 P cfb205e1a5b64de0ac35a84d9058e9f7: Deleting consensus metadata
I20260619 04:44:08.058893 28284 ts_tablet_manager.cc:1918] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:08.059018 27780 catalog_manager.cc:4841] TS cfb205e1a5b64de0ac35a84d9058e9f7 (127.9.224.66:39563): tablet b1b0ca9ee1974466b2891d05a17d6cd4 (table test-table [id=12a74e56e24540f4a373a0ed09172ec4]) successfully deleted
I20260619 04:44:08.059183 28284 log.cc:1196] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b1b0ca9ee1974466b2891d05a17d6cd4
I20260619 04:44:08.059648 28284 ts_tablet_manager.cc:1939] T b1b0ca9ee1974466b2891d05a17d6cd4 P ba45121c65094a7580aab2b55671af8c: Deleting consensus metadata
I20260619 04:44:08.061177 27781 catalog_manager.cc:4841] TS ba45121c65094a7580aab2b55671af8c (127.9.224.67:35703): tablet b1b0ca9ee1974466b2891d05a17d6cd4 (table test-table [id=12a74e56e24540f4a373a0ed09172ec4]) successfully deleted
I20260619 04:44:08.163179 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27853
W20260619 04:44:08.181237 27781 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.224.65:40109 (error 108)
I20260619 04:44:08.181967 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27984
I20260619 04:44:08.183414 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.182881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45534)
0619 04:44:08.183111 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.183231 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260619 04:44:08.183712 27781 catalog_manager.cc:4584] TS e56f3881843e48bdb896957671dc6d73 (127.9.224.65:40109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1b0ca9ee1974466b2891d05a17d6cd4: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
I20260619 04:44:08.190555 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.182968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.9.224.66:39563)
0619 04:44:08.183206 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:08.183212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:08.183265 (+ 53us) server_negotiation.cc:407] Connection header received
0619 04:44:08.183475 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:08.183481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:08.183590 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:08.183703 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:08.184227 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:08.185427 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:08.186998 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:08.187694 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:08.187818 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:08.188861 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:08.188872 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:08.188892 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:08.189703 (+ 811us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:08.189757 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:08.189785 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:08.189884 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:08.190006 (+ 122us) server_negotiation.cc:299] Negotiation successful
0619 04:44:08.190125 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 04:44:08.191349 28106 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:08.237656 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.237099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45548)
0619 04:44:08.237374 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.237485 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260619 04:44:08.238885 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.238518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45556)
0619 04:44:08.238670 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.238758 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260619 04:44:08.299590 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.299062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45562)
0619 04:44:08.299307 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.299394 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260619 04:44:08.300616 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.300244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45566)
0619 04:44:08.300405 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.300499 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260619 04:44:08.308357 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27984
I20260619 04:44:08.327904 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28114
I20260619 04:44:08.335238 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.328817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56980 (local address 127.9.224.67:35703)
0619 04:44:08.329028 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:08.329036 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:08.329056 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:44:08.329292 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:08.329296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:08.329392 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:08.329514 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:08.329953 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:08.330775 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:08.332080 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:08.332475 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:08.332612 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:08.333689 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:08.333699 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:08.333714 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:08.334502 (+ 788us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:08.334550 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:08.334570 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:08.334706 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:08.334813 (+ 107us) server_negotiation.cc:299] Negotiation successful
0619 04:44:08.334918 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:44:08.335985 28236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:08.381258 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.380679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45582)
0619 04:44:08.380928 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.381055 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260619 04:44:08.382494 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.381977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45598)
0619 04:44:08.382209 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.382335 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260619 04:44:08.426921 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28114
I20260619 04:44:08.444093 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 27763
I20260619 04:44:08.445367 27824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:08.556968 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:08.556445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40109 (local address 127.0.0.1:45606)
0619 04:44:08.556662 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:08.556755 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 04:44:08.556973 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 27763
2026-06-19T04:44:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2869 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:08 dist-test-slave-9dgf krb5kdc[28294](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:08 dist-test-slave-9dgf krb5kdc[28294](info): set up 2 sockets
Jun 19 04:44:08 dist-test-slave-9dgf krb5kdc[28294](info): commencing operation
krb5kdc: starting...
W20260619 04:44:09.682494 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:09 dist-test-slave-9dgf krb5kdc[28294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:09.939198 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:45319
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:45319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:10.278776 28307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:10.279063 28307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:10.279242 28307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:10.286697 28307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:10.286811 28307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:10.286895 28307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:10.287002 28307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:10.287083 28307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:10.297250 28307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:45319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:45319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:10.298626 28307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:10.299945 28307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:10.311547 28315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:10.311636 28313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:10.311520 28312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:10.312958 28307 server_base.cc:1034] running on GCE node
I20260619 04:44:10.313762 28307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:10.315255 28307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:10.316519 28307 hybrid_clock.cc:648] HybridClock initialized: now 1781844250316467 us; error 44 us; skew 500 ppm
I20260619 04:44:10.316946 28307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:10 dist-test-slave-9dgf krb5kdc[28294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844250, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:10.320474 28307 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:10.322088 28307 webserver.cc:460] Webserver started at http://127.9.224.126:46395/ using document root <none> and password file <none>
I20260619 04:44:10.322921 28307 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:10.323030 28307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:10.323370 28307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:10.326452 28307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "e886a40421dc4d60a7efaf594ec3a1be"
format_stamp: "Formatted at 2026-06-19 04:44:10 on dist-test-slave-9dgf"
server_key: "b8c7fee39c3b561e96ab8e523869cd7f"
server_key_iv: "e8a6595d286e47aa6d8ad654e693e4d1"
server_key_version: "encryptionkey@0"
I20260619 04:44:10.327172 28307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "e886a40421dc4d60a7efaf594ec3a1be"
format_stamp: "Formatted at 2026-06-19 04:44:10 on dist-test-slave-9dgf"
server_key: "b8c7fee39c3b561e96ab8e523869cd7f"
server_key_iv: "e8a6595d286e47aa6d8ad654e693e4d1"
server_key_version: "encryptionkey@0"
I20260619 04:44:10.332515 28307 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:10.336540 28322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:10.338050 28307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260619 04:44:10.338291 28307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "e886a40421dc4d60a7efaf594ec3a1be"
format_stamp: "Formatted at 2026-06-19 04:44:10 on dist-test-slave-9dgf"
server_key: "b8c7fee39c3b561e96ab8e523869cd7f"
server_key_iv: "e8a6595d286e47aa6d8ad654e693e4d1"
server_key_version: "encryptionkey@0"
I20260619 04:44:10.338541 28307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:10.354732 28307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:10.359375 28307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:10.359715 28307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:10.379608 28307 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:45319
I20260619 04:44:10.379631 28373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:45319 every 8 connection(s)
I20260619 04:44:10.381143 28307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:10.384595 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28307
I20260619 04:44:10.384826 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:10.385288 10113 external_mini_cluster.cc:1428] Setting key 92edd4c9b6117c34bc81a4781243e755
I20260619 04:44:10.385296 28374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:10.401089 28374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be: Bootstrap starting.
Jun 19 04:44:10 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:10.404785 28374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:10.405969 28374 log.cc:824] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:10.408957 28374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be: No bootstrap required, opened a new log
I20260619 04:44:10.410653 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:10.387206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47622 (local address 127.9.224.126:45319)
0619 04:44:10.388025 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:10.388037 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:10.388084 (+ 47us) server_negotiation.cc:407] Connection header received
0619 04:44:10.390314 (+ 2230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:10.390367 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:10.390805 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:10.391156 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:10.393292 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:10.395079 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:10.397063 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:10.397798 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:10.398022 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:10.403150 (+ 5128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:10.403160 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:10.403179 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:10.403227 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:10.406465 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:10.407243 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:10.407256 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:10.407262 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:10.407433 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:10.407833 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:10.407839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:10.407842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:10.408379 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:10.408697 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:10.409144 (+ 447us) server_negotiation.cc:299] Negotiation successful
0619 04:44:10.409595 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":388,"threads_started":1}
I20260619 04:44:10.417603 28374 raft_consensus.cc:348] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e886a40421dc4d60a7efaf594ec3a1be" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45319 } }
I20260619 04:44:10.418022 28374 raft_consensus.cc:374] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:10.418146 28374 raft_consensus.cc:729] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e886a40421dc4d60a7efaf594ec3a1be, State: Initialized, Role: FOLLOWER
I20260619 04:44:10.418771 28374 consensus_queue.cc:260] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e886a40421dc4d60a7efaf594ec3a1be" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45319 } }
I20260619 04:44:10.419027 28374 raft_consensus.cc:388] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:10.419202 28374 raft_consensus.cc:482] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:10.419392 28374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:10.422076 28374 raft_consensus.cc:504] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e886a40421dc4d60a7efaf594ec3a1be" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45319 } }
I20260619 04:44:10.422654 28374 leader_election.cc:302] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e886a40421dc4d60a7efaf594ec3a1be; no voters:
I20260619 04:44:10.423237 28374 leader_election.cc:288] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:10.423405 28379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:10.424088 28379 raft_consensus.cc:686] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [term 1 LEADER]: Becoming Leader. State: Replica: e886a40421dc4d60a7efaf594ec3a1be, State: Running, Role: LEADER
I20260619 04:44:10.424691 28379 consensus_queue.cc:237] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e886a40421dc4d60a7efaf594ec3a1be" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45319 } }
I20260619 04:44:10.425329 28374 sys_catalog.cc:564] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:10.427884 28381 sys_catalog.cc:455] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [sys.catalog]: SysCatalogTable state changed. Reason: New leader e886a40421dc4d60a7efaf594ec3a1be. Latest consensus state: current_term: 1 leader_uuid: "e886a40421dc4d60a7efaf594ec3a1be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e886a40421dc4d60a7efaf594ec3a1be" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45319 } } }
I20260619 04:44:10.427776 28380 sys_catalog.cc:455] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e886a40421dc4d60a7efaf594ec3a1be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e886a40421dc4d60a7efaf594ec3a1be" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 45319 } } }
I20260619 04:44:10.428233 28381 sys_catalog.cc:458] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:10.428292 28380 sys_catalog.cc:458] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:10.430123 28387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:10.435803 28387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:10.446377 28387 catalog_manager.cc:1347] Generated new cluster ID: 4dacc2c2057741b098e9850b775334be
I20260619 04:44:10.446522 28387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:10.462774 28387 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:10.464227 28387 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:10.473992 28387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be: Generated new TSK 0
I20260619 04:44:10.474929 28387 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:44:10.535872 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45319
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:10.893332 28400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:10.893633 28400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:10.893774 28400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:10.901255 28400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:10.901366 28400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:10.901629 28400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:44:10.911819 28400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:10.913230 28400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:10.914641 28400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:10.928623 28406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:10.928610 28408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:10.928725 28405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:10.929513 28400 server_base.cc:1034] running on GCE node
I20260619 04:44:10.930156 28400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:10.931190 28400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:10.932444 28400 hybrid_clock.cc:648] HybridClock initialized: now 1781844250932389 us; error 47 us; skew 500 ppm
I20260619 04:44:10.932837 28400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:10 dist-test-slave-9dgf krb5kdc[28294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844250, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:10.936102 28400 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:44:10.937557 28400 webserver.cc:460] Webserver started at http://127.9.224.65:38111/ using document root <none> and password file <none>
I20260619 04:44:10.938356 28400 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:10.938508 28400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:10.938854 28400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:10.941879 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "95290525baee4511b596ba3b5cf69f5b"
format_stamp: "Formatted at 2026-06-19 04:44:10 on dist-test-slave-9dgf"
server_key: "0256f94874b98fd6dc00a70d28034536"
server_key_iv: "e87105ef7143a31537148ed52e02dbf4"
server_key_version: "encryptionkey@0"
I20260619 04:44:10.942844 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "95290525baee4511b596ba3b5cf69f5b"
format_stamp: "Formatted at 2026-06-19 04:44:10 on dist-test-slave-9dgf"
server_key: "0256f94874b98fd6dc00a70d28034536"
server_key_iv: "e87105ef7143a31537148ed52e02dbf4"
server_key_version: "encryptionkey@0"
I20260619 04:44:10.948282 28400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:10.951864 28415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:10.953404 28400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:44:10.953601 28400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "95290525baee4511b596ba3b5cf69f5b"
format_stamp: "Formatted at 2026-06-19 04:44:10 on dist-test-slave-9dgf"
server_key: "0256f94874b98fd6dc00a70d28034536"
server_key_iv: "e87105ef7143a31537148ed52e02dbf4"
server_key_version: "encryptionkey@0"
I20260619 04:44:10.953819 28400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:10.985000 28400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:10.989600 28400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:10.989917 28400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:10.990989 28400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:10.992367 28400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:10.992475 28400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:10.992625 28400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:10.992713 28400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:11.028294 28400 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:43199
I20260619 04:44:11.028395 28527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:43199 every 8 connection(s)
I20260619 04:44:11.029712 28400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:44:11.035199 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28400
I20260619 04:44:11.035401 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:44:11.035861 10113 external_mini_cluster.cc:1428] Setting key 287cd3625e93a5fcf62a8d2702296f1c
Jun 19 04:44:11 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844250, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:11.050997 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:11.032596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:37313 (local address 127.9.224.126:45319)
0619 04:44:11.033108 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:11.033113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:11.034220 (+ 1107us) server_negotiation.cc:407] Connection header received
0619 04:44:11.036270 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:11.036276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:11.036379 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:11.036498 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:11.038020 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.038817 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.040388 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.040798 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.040940 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:11.044721 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:11.044726 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:11.044729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:11.044764 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:11.047804 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:11.048584 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:11.048589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:11.048593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:11.048728 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:11.049169 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:11.049175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:11.049178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:11.049459 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:11.049614 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:11.050379 (+ 765us) server_negotiation.cc:299] Negotiation successful
0619 04:44:11.050618 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":265,"threads_started":1}
I20260619 04:44:11.052073 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:11.033255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45319 (local address 127.9.224.65:37313)
0619 04:44:11.034022 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:11.034067 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:11.035973 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:11.036746 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:11.036754 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:11.037300 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:11.037857 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:11.037874 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.038976 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.038988 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:11.040231 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:11.040242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.041028 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.041037 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:11.041303 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:11.042010 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:11.042032 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:11.044472 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:11.047969 (+ 3497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:11.047978 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:11.047998 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:11.048457 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:11.048845 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:11.048850 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:11.048853 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:11.049055 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:11.049588 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:11.049596 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:11.049971 (+ 375us) client_negotiation.cc:769] Sending connection context
0619 04:44:11.050282 (+ 311us) client_negotiation.cc:240] Negotiation successful
0619 04:44:11.050868 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":332,"threads_started":1}
I20260619 04:44:11.053889 28528 heartbeater.cc:347] Connected to a master server at 127.9.224.126:45319
I20260619 04:44:11.054224 28528 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:11.055064 28528 heartbeater.cc:511] Master 127.9.224.126:45319 requested a full tablet report, sending...
I20260619 04:44:11.057406 28339 ts_manager.cc:194] Registered new tserver with Master: 95290525baee4511b596ba3b5cf69f5b (127.9.224.65:43199)
I20260619 04:44:11.059020 28339 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:37313
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:44:11.094031 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45319
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:11.428740 28534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:11.429044 28534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:11.429142 28534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:11.436573 28534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:11.436703 28534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:11.436825 28534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:44:11.447420 28534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:11.448887 28534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:11.450170 28534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:11.463677 28539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:11.463661 28540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:11.463748 28542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:11.464913 28534 server_base.cc:1034] running on GCE node
I20260619 04:44:11.465636 28534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:11.466753 28534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:11.467985 28534 hybrid_clock.cc:648] HybridClock initialized: now 1781844251467943 us; error 37 us; skew 500 ppm
I20260619 04:44:11.468323 28534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:11 dist-test-slave-9dgf krb5kdc[28294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844251, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:11.476662 28534 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:44:11.478283 28534 webserver.cc:460] Webserver started at http://127.9.224.66:38325/ using document root <none> and password file <none>
I20260619 04:44:11.479012 28534 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:11.479157 28534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:11.479480 28534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:11.482620 28534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "b6b75764a6d741e0b0e29177bbb5fa00"
format_stamp: "Formatted at 2026-06-19 04:44:11 on dist-test-slave-9dgf"
server_key: "568b28cecad69e8c817593e44b63dd2c"
server_key_iv: "c1e0c2ba7a3e3b21f7ba7330130ada11"
server_key_version: "encryptionkey@0"
I20260619 04:44:11.483419 28534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "b6b75764a6d741e0b0e29177bbb5fa00"
format_stamp: "Formatted at 2026-06-19 04:44:11 on dist-test-slave-9dgf"
server_key: "568b28cecad69e8c817593e44b63dd2c"
server_key_iv: "c1e0c2ba7a3e3b21f7ba7330130ada11"
server_key_version: "encryptionkey@0"
I20260619 04:44:11.488634 28534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:11.492214 28549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:11.493557 28534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:44:11.493737 28534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "b6b75764a6d741e0b0e29177bbb5fa00"
format_stamp: "Formatted at 2026-06-19 04:44:11 on dist-test-slave-9dgf"
server_key: "568b28cecad69e8c817593e44b63dd2c"
server_key_iv: "c1e0c2ba7a3e3b21f7ba7330130ada11"
server_key_version: "encryptionkey@0"
I20260619 04:44:11.493960 28534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:11.520824 28534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:11.525754 28534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:11.526065 28534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:11.527194 28534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:11.528632 28534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:11.528707 28534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:11.528792 28534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:11.528836 28534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:11.562256 28534 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:33427
I20260619 04:44:11.562357 28661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:33427 every 8 connection(s)
I20260619 04:44:11.563578 28534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:44:11.570454 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28534
I20260619 04:44:11.570667 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:44:11.571239 10113 external_mini_cluster.cc:1428] Setting key 7ca102e4e0fcb4a6ab5fb9ce6149f706
Jun 19 04:44:11 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844251, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:11.586354 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:11.566281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:33545 (local address 127.9.224.126:45319)
0619 04:44:11.566723 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:11.566727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:11.567725 (+ 998us) server_negotiation.cc:407] Connection header received
0619 04:44:11.569600 (+ 1875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:11.569606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:11.569715 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:11.569835 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:11.571977 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.572966 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.574700 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.575489 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.575638 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:11.579605 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:11.579615 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:11.579623 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:11.579680 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:11.582868 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:11.583896 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:11.583900 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:11.583902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:11.584036 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:11.584530 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:11.584534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:11.584536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:11.584806 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:11.584915 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:11.585839 (+ 924us) server_negotiation.cc:299] Negotiation successful
0619 04:44:11.586009 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":321,"thread_start_us":214,"threads_started":1}
I20260619 04:44:11.587881 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:11.566862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45319 (local address 127.9.224.66:33545)
0619 04:44:11.567539 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:11.567575 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:11.569331 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:11.570098 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:11.570111 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:11.570924 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:11.571776 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:11.571802 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.573167 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.573173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:11.574548 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:11.574564 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:11.575755 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:11.575762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:11.575980 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:11.576843 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:11.576869 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:11.579323 (+ 2454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:11.583020 (+ 3697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:11.583033 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:11.583055 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:11.583759 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:11.584151 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:11.584159 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:11.584165 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:11.584408 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:11.584938 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:11.584950 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:11.585421 (+ 471us) client_negotiation.cc:769] Sending connection context
0619 04:44:11.585723 (+ 302us) client_negotiation.cc:240] Negotiation successful
0619 04:44:11.586360 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":271,"threads_started":1}
I20260619 04:44:11.589589 28662 heartbeater.cc:347] Connected to a master server at 127.9.224.126:45319
I20260619 04:44:11.589942 28662 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:11.590844 28662 heartbeater.cc:511] Master 127.9.224.126:45319 requested a full tablet report, sending...
I20260619 04:44:11.592412 28339 ts_manager.cc:194] Registered new tserver with Master: b6b75764a6d741e0b0e29177bbb5fa00 (127.9.224.66:33427)
I20260619 04:44:11.593272 28339 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:33545
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:44:11.633819 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45319
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:11.967747 28668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:11.968060 28668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:11.968225 28668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:11.975606 28668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:11.975756 28668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:11.975951 28668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:44:11.985704 28668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:45319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:11.987123 28668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:11.988463 28668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:12.002197 28676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:12.002272 28673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:12.002245 28674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:12.007864 28668 server_base.cc:1034] running on GCE node
I20260619 04:44:12.008605 28668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:12.009699 28668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:12.010951 28668 hybrid_clock.cc:648] HybridClock initialized: now 1781844252010893 us; error 42 us; skew 500 ppm
I20260619 04:44:12.011309 28668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:12 dist-test-slave-9dgf krb5kdc[28294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844252, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:12.014981 28668 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:44:12.016604 28668 webserver.cc:460] Webserver started at http://127.9.224.67:36219/ using document root <none> and password file <none>
I20260619 04:44:12.017405 28668 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:12.017565 28668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:12.017933 28668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:12.021430 28668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "e752900fb6234a5a968ee5ea9ab687a0"
format_stamp: "Formatted at 2026-06-19 04:44:12 on dist-test-slave-9dgf"
server_key: "4867629397b0acded1a03f7cae6a9d99"
server_key_iv: "7f29f48c66b3c1fb13f605f778bc17ab"
server_key_version: "encryptionkey@0"
I20260619 04:44:12.022424 28668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "e752900fb6234a5a968ee5ea9ab687a0"
format_stamp: "Formatted at 2026-06-19 04:44:12 on dist-test-slave-9dgf"
server_key: "4867629397b0acded1a03f7cae6a9d99"
server_key_iv: "7f29f48c66b3c1fb13f605f778bc17ab"
server_key_version: "encryptionkey@0"
I20260619 04:44:12.028497 28668 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260619 04:44:12.033075 28683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:12.034747 28668 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 04:44:12.034885 28668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "e752900fb6234a5a968ee5ea9ab687a0"
format_stamp: "Formatted at 2026-06-19 04:44:12 on dist-test-slave-9dgf"
server_key: "4867629397b0acded1a03f7cae6a9d99"
server_key_iv: "7f29f48c66b3c1fb13f605f778bc17ab"
server_key_version: "encryptionkey@0"
I20260619 04:44:12.035063 28668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:12.053903 28668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:12.058959 28668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:12.059271 28668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:12.060308 28668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:12.062264 28668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:12.062405 28668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260619 04:44:12.062572 28668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:12.062516 28528 heartbeater.cc:503] Master 127.9.224.126:45319 was elected leader, sending a full tablet report...
I20260619 04:44:12.062656 28668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:12.104359 28668 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:40279
I20260619 04:44:12.104580 28795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:40279 every 8 connection(s)
I20260619 04:44:12.105789 28668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:44:12.109622 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28668
I20260619 04:44:12.109807 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:44:12.110388 10113 external_mini_cluster.cc:1428] Setting key 624d48b9bd9a86f4fb8a15568440b7b3
Jun 19 04:44:12 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844252, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:12.131152 28799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.110025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:43021 (local address 127.9.224.126:45319)
0619 04:44:12.110541 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.110547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.110573 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:44:12.113152 (+ 2579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.113159 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.113257 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.113371 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:12.115003 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.115913 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.117500 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.117916 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.118048 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.122068 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:12.122074 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:12.122079 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:12.122121 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:12.127273 (+ 5152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.128332 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.128337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.128341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.128488 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.129008 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.129013 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.129017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.129386 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:12.129569 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.130464 (+ 895us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.130719 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":951,"threads_started":1}
I20260619 04:44:12.132366 28798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.109461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:45319 (local address 127.9.224.67:43021)
0619 04:44:12.110415 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.110463 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.112813 (+ 2350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.113638 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.113647 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.114185 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:12.114834 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.114854 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.116071 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.116076 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.117351 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.117363 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.118155 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.118161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.118481 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.119176 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:12.119204 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:12.121778 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:12.127472 (+ 5694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:12.127485 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:12.127506 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:12.128172 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:12.128614 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:12.128618 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:12.128622 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:12.128878 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:12.129532 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:12.129540 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:12.130003 (+ 463us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.130357 (+ 354us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.130959 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":539,"threads_started":1}
I20260619 04:44:12.133852 28796 heartbeater.cc:347] Connected to a master server at 127.9.224.126:45319
I20260619 04:44:12.134178 28796 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:12.134961 28796 heartbeater.cc:511] Master 127.9.224.126:45319 requested a full tablet report, sending...
I20260619 04:44:12.136492 28339 ts_manager.cc:194] Registered new tserver with Master: e752900fb6234a5a968ee5ea9ab687a0 (127.9.224.67:40279)
I20260619 04:44:12.137326 28339 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:43021
I20260619 04:44:12.143790 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:44:12.162740 28799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.148223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47632 (local address 127.9.224.126:45319)
0619 04:44:12.148429 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.148435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.148937 (+ 502us) server_negotiation.cc:407] Connection header received
0619 04:44:12.149124 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.149129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.149204 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.149297 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:12.150933 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.151861 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.153290 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.153752 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.153858 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.156651 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:12.156656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:12.156659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:12.156736 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:12.159708 (+ 2972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.160544 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.160549 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.160552 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.160736 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.161249 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.161253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.161255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.161577 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:12.161784 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.162167 (+ 383us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.162458 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:44:12.167176 28339 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:44:12.174350 28339 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:44:12.201138 28809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.187034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:40279 (local address 127.0.0.1:55990)
0619 04:44:12.189044 (+ 2010us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.189080 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.189351 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.190579 (+ 1228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.190603 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.190647 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.191248 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.191265 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.193932 (+ 2667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.193940 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.197079 (+ 3139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.197100 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.200058 (+ 2958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.200064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.200308 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.200365 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.200499 (+ 134us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.200702 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1784,"mutex_wait_us":2,"thread_start_us":1637,"threads_started":1}
I20260619 04:44:12.201213 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.187388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55990 (local address 127.9.224.67:40279)
0619 04:44:12.188714 (+ 1326us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.188727 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.189196 (+ 469us) server_negotiation.cc:407] Connection header received
0619 04:44:12.189630 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.189642 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.189923 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.190134 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.191520 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.193706 (+ 2186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.197320 (+ 3614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.199409 (+ 2089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.199512 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.199783 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.200685 (+ 902us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.200854 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1085,"thread_start_us":902,"threads_started":1}
I20260619 04:44:12.203866 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.188256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48886 (local address 127.9.224.65:43199)
0619 04:44:12.189365 (+ 1109us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.189376 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.191566 (+ 2190us) server_negotiation.cc:407] Connection header received
0619 04:44:12.191787 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.191796 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.192083 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.192303 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.193394 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.196700 (+ 3306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.200704 (+ 4004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.202465 (+ 1761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.202608 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.202849 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.203357 (+ 508us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.203524 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":916,"thread_start_us":743,"threads_started":1}
I20260619 04:44:12.204639 28810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.187548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:43199 (local address 127.0.0.1:48886)
0619 04:44:12.189789 (+ 2241us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.189803 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.189959 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.192630 (+ 2671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.192638 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.192674 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.193169 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.193184 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.196912 (+ 3728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.196920 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.200453 (+ 3533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.200473 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.202914 (+ 2441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.202921 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.203184 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.203209 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.203307 (+ 98us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.203439 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2143,"mutex_wait_us":18,"thread_start_us":2005,"threads_started":1}
I20260619 04:44:12.206038 28731 tablet_service.cc:1467] Processing CreateTablet for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 (DEFAULT_TABLE table=test-table [id=39eb0998055248e48f97efe04362332c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:12.207670 28731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:12.209162 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.189563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:33427 (local address 127.0.0.1:41530)
0619 04:44:12.200243 (+ 10680us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.200264 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.200370 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.202520 (+ 2150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.202524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.202553 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.202979 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.202991 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.204833 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.204838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.206503 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.206518 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.208307 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.208314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.208480 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.208513 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.208630 (+ 117us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.208784 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10540,"mutex_wait_us":27,"thread_start_us":10900,"threads_started":1}
I20260619 04:44:12.209192 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.190058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.9.224.66:33427)
0619 04:44:12.201883 (+ 11825us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.201894 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.201926 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:44:12.202029 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.202036 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.202330 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.202536 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.203178 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.204660 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.206677 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.208084 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.208237 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.208422 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.208690 (+ 268us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.208864 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11641,"thread_start_us":11503,"threads_started":1}
I20260619 04:44:12.208750 28463 tablet_service.cc:1467] Processing CreateTablet for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 (DEFAULT_TABLE table=test-table [id=39eb0998055248e48f97efe04362332c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:12.210438 28463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:12.213330 28597 tablet_service.cc:1467] Processing CreateTablet for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 (DEFAULT_TABLE table=test-table [id=39eb0998055248e48f97efe04362332c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:12.214743 28597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:12.220079 28815 tablet_bootstrap.cc:492] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Bootstrap starting.
I20260619 04:44:12.223326 28815 tablet_bootstrap.cc:654] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:12.224349 28815 log.cc:824] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:12.226429 28816 tablet_bootstrap.cc:492] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Bootstrap starting.
I20260619 04:44:12.228497 28815 tablet_bootstrap.cc:492] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: No bootstrap required, opened a new log
I20260619 04:44:12.228838 28815 ts_tablet_manager.cc:1397] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 04:44:12.229766 28818 tablet_bootstrap.cc:492] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Bootstrap starting.
I20260619 04:44:12.230893 28816 tablet_bootstrap.cc:654] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:12.232303 28816 log.cc:824] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:12.233412 28818 tablet_bootstrap.cc:654] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:12.234702 28818 log.cc:824] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:12.235719 28816 tablet_bootstrap.cc:492] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: No bootstrap required, opened a new log
I20260619 04:44:12.235991 28816 ts_tablet_manager.cc:1397] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260619 04:44:12.237466 28815 raft_consensus.cc:348] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.237818 28818 tablet_bootstrap.cc:492] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: No bootstrap required, opened a new log
I20260619 04:44:12.237943 28815 raft_consensus.cc:374] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:12.238092 28818 ts_tablet_manager.cc:1397] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 04:44:12.238123 28815 raft_consensus.cc:729] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e752900fb6234a5a968ee5ea9ab687a0, State: Initialized, Role: FOLLOWER
I20260619 04:44:12.238844 28815 consensus_queue.cc:260] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.245810 28796 heartbeater.cc:503] Master 127.9.224.126:45319 was elected leader, sending a full tablet report...
I20260619 04:44:12.246683 28815 ts_tablet_manager.cc:1428] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Time spent starting tablet: real 0.018s user 0.020s sys 0.000s
I20260619 04:44:12.247306 28816 raft_consensus.cc:348] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.247778 28816 raft_consensus.cc:374] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:12.247887 28816 raft_consensus.cc:729] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95290525baee4511b596ba3b5cf69f5b, State: Initialized, Role: FOLLOWER
I20260619 04:44:12.248524 28816 consensus_queue.cc:260] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.250435 28816 ts_tablet_manager.cc:1428] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260619 04:44:12.253122 28818 raft_consensus.cc:348] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.253607 28818 raft_consensus.cc:374] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:12.253720 28818 raft_consensus.cc:729] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6b75764a6d741e0b0e29177bbb5fa00, State: Initialized, Role: FOLLOWER
I20260619 04:44:12.254444 28818 consensus_queue.cc:260] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.255475 28662 heartbeater.cc:503] Master 127.9.224.126:45319 was elected leader, sending a full tablet report...
I20260619 04:44:12.256187 28818 ts_tablet_manager.cc:1428] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Time spent starting tablet: real 0.018s user 0.007s sys 0.006s
W20260619 04:44:12.282511 28529 tablet.cc:2369] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:12.315706 28663 tablet.cc:2369] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:12.357468 28797 tablet.cc:2369] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:12.501739 28823 raft_consensus.cc:482] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:12.502104 28823 raft_consensus.cc:504] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.504097 28823 leader_election.cc:288] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e752900fb6234a5a968ee5ea9ab687a0 (127.9.224.67:40279), 95290525baee4511b596ba3b5cf69f5b (127.9.224.65:43199)
I20260619 04:44:12.511629 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.504925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:46817 (local address 127.9.224.65:43199)
0619 04:44:12.505213 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.505221 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.505782 (+ 561us) server_negotiation.cc:407] Connection header received
0619 04:44:12.506025 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.506029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.506091 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.506196 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.506839 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.507668 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.509624 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.510559 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.510716 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.510770 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.511229 (+ 459us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.511361 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:44:12.511839 28824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.504546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:43199 (local address 127.9.224.66:46817)
0619 04:44:12.505609 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.505631 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.505873 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.506202 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.506207 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.506254 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.506681 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.506700 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.507795 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.507803 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.509472 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.509485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.510804 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.510813 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.510997 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.511041 (+ 44us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.511168 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.511395 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906,"mutex_wait_us":94,"spinlock_wait_cycles":20224,"thread_start_us":637,"threads_started":1}
I20260619 04:44:12.512208 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.504639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:40279 (local address 127.9.224.66:54973)
0619 04:44:12.505765 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.505785 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.505957 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.506376 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.506381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.506423 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.506913 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.506928 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.508120 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.508126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.509731 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.509743 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.511291 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.511298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.511481 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.511518 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.511616 (+ 98us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.511778 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":968,"mutex_wait_us":24,"thread_start_us":717,"threads_started":1}
I20260619 04:44:12.512568 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.504575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:54973 (local address 127.9.224.67:40279)
0619 04:44:12.504871 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.504884 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.505888 (+ 1004us) server_negotiation.cc:407] Connection header received
0619 04:44:12.506106 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.506120 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.506188 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.506351 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.507155 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.507961 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.509891 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.511070 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.511231 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.511310 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.512101 (+ 791us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.512254 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 04:44:12.513121 28483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c3b3eeca2f4b34bafba67a8b27a0f2" candidate_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95290525baee4511b596ba3b5cf69f5b" is_pre_election: true
I20260619 04:44:12.513411 28751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c3b3eeca2f4b34bafba67a8b27a0f2" candidate_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e752900fb6234a5a968ee5ea9ab687a0" is_pre_election: true
I20260619 04:44:12.513805 28483 raft_consensus.cc:2454] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6b75764a6d741e0b0e29177bbb5fa00 in term 0.
I20260619 04:44:12.513840 28821 raft_consensus.cc:482] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:12.514127 28821 raft_consensus.cc:504] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.514611 28553 leader_election.cc:302] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95290525baee4511b596ba3b5cf69f5b, b6b75764a6d741e0b0e29177bbb5fa00; no voters:
I20260619 04:44:12.514930 28751 raft_consensus.cc:2454] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6b75764a6d741e0b0e29177bbb5fa00 in term 0.
I20260619 04:44:12.515039 28823 raft_consensus.cc:2781] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:44:12.515184 28823 raft_consensus.cc:482] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:44:12.515311 28823 raft_consensus.cc:3037] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:12.516194 28821 leader_election.cc:288] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6b75764a6d741e0b0e29177bbb5fa00 (127.9.224.66:33427), 95290525baee4511b596ba3b5cf69f5b (127.9.224.65:43199)
I20260619 04:44:12.519284 28823 raft_consensus.cc:504] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.520247 28823 leader_election.cc:288] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [CANDIDATE]: Term 1 election: Requested vote from peers e752900fb6234a5a968ee5ea9ab687a0 (127.9.224.67:40279), 95290525baee4511b596ba3b5cf69f5b (127.9.224.65:43199)
I20260619 04:44:12.520932 28483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c3b3eeca2f4b34bafba67a8b27a0f2" candidate_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95290525baee4511b596ba3b5cf69f5b"
I20260619 04:44:12.521199 28483 raft_consensus.cc:3037] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:12.521844 28751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c3b3eeca2f4b34bafba67a8b27a0f2" candidate_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e752900fb6234a5a968ee5ea9ab687a0"
I20260619 04:44:12.522119 28751 raft_consensus.cc:3037] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:12.524020 28798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.516600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:33427 (local address 127.9.224.67:34267)
0619 04:44:12.516903 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.516927 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.517039 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.517593 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.517598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.517626 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.517836 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.517846 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.519068 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.519074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.521224 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.521242 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.523113 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.523119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.523337 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.523371 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.523467 (+ 96us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.523634 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165}
I20260619 04:44:12.524741 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.517075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:34267 (local address 127.9.224.66:33427)
0619 04:44:12.517306 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.517311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.517331 (+ 20us) server_negotiation.cc:407] Connection header received
0619 04:44:12.517397 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.517402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.517480 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.517578 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.517980 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.518910 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.521396 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.522802 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.522947 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.523024 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.524335 (+ 1311us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.524493 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260619 04:44:12.525004 28483 raft_consensus.cc:2454] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6b75764a6d741e0b0e29177bbb5fa00 in term 1.
I20260619 04:44:12.525949 28553 leader_election.cc:302] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95290525baee4511b596ba3b5cf69f5b, b6b75764a6d741e0b0e29177bbb5fa00; no voters:
I20260619 04:44:12.525969 28751 raft_consensus.cc:2454] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6b75764a6d741e0b0e29177bbb5fa00 in term 1.
I20260619 04:44:12.526479 28823 raft_consensus.cc:2781] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:12.527010 28823 raft_consensus.cc:686] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 1 LEADER]: Becoming Leader. State: Replica: b6b75764a6d741e0b0e29177bbb5fa00, State: Running, Role: LEADER
I20260619 04:44:12.527164 28617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c3b3eeca2f4b34bafba67a8b27a0f2" candidate_uuid: "e752900fb6234a5a968ee5ea9ab687a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" is_pre_election: true
I20260619 04:44:12.527626 28823 consensus_queue.cc:237] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } }
I20260619 04:44:12.528846 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.516640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:43199 (local address 127.9.224.67:34709)
0619 04:44:12.520948 (+ 4308us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:12.520965 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:12.521115 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:12.521583 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:12.521588 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:12.521613 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:12.522069 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.522082 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.523705 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.523710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.525935 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:12.525948 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.527961 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.527967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:12.528135 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.528168 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 04:44:12.528330 (+ 162us) client_negotiation.cc:240] Negotiation successful
0619 04:44:12.528502 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4182,"thread_start_us":4021,"threads_started":1}
I20260619 04:44:12.529165 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.516553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:34709 (local address 127.9.224.65:43199)
0619 04:44:12.518110 (+ 1557us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.518116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.521053 (+ 2937us) server_negotiation.cc:407] Connection header received
0619 04:44:12.521260 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.521265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.521339 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.521425 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:12.522329 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.523514 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.526095 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.527571 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.527751 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.527825 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.528369 (+ 544us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.528558 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1419}
I20260619 04:44:12.529807 28483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c3b3eeca2f4b34bafba67a8b27a0f2" candidate_uuid: "e752900fb6234a5a968ee5ea9ab687a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95290525baee4511b596ba3b5cf69f5b" is_pre_election: true
I20260619 04:44:12.530146 28483 raft_consensus.cc:2379] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e752900fb6234a5a968ee5ea9ab687a0 in current term 1: Already voted for candidate b6b75764a6d741e0b0e29177bbb5fa00 in this term.
I20260619 04:44:12.530857 28687 leader_election.cc:302] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e752900fb6234a5a968ee5ea9ab687a0; no voters: 95290525baee4511b596ba3b5cf69f5b, b6b75764a6d741e0b0e29177bbb5fa00
I20260619 04:44:12.532059 28821 raft_consensus.cc:2726] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 04:44:12.533293 28338 catalog_manager.cc:5495] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6b75764a6d741e0b0e29177bbb5fa00 (127.9.224.66). New cstate: current_term: 1 leader_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6b75764a6d741e0b0e29177bbb5fa00" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 33427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 } health_report { overall_health: UNKNOWN } } }
I20260619 04:44:12.571430 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.565046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41546 (local address 127.9.224.66:33427)
0619 04:44:12.565239 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.565251 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.565416 (+ 165us) server_negotiation.cc:407] Connection header received
0619 04:44:12.565592 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.565599 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.565720 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.565861 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:44:12.566192 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.567410 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.568843 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.569513 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.569625 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.570172 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:44:12.570791 (+ 619us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:44:12.570948 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.571073 (+ 125us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.571136 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 04:44:12.581393 28483 raft_consensus.cc:1261] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 1 FOLLOWER]: Refusing update from remote peer b6b75764a6d741e0b0e29177bbb5fa00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:12.581437 28751 raft_consensus.cc:1261] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 1 FOLLOWER]: Refusing update from remote peer b6b75764a6d741e0b0e29177bbb5fa00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:12.582350 28827 consensus_queue.cc:1035] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95290525baee4511b596ba3b5cf69f5b" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:12.582741 28823 consensus_queue.cc:1035] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e752900fb6234a5a968ee5ea9ab687a0" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:12.612985 28337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:12.613373 28337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:12.617530 28337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e886a40421dc4d60a7efaf594ec3a1be: Sending DeleteTablet for 3 replicas of tablet b6c3b3eeca2f4b34bafba67a8b27a0f2
I20260619 04:44:12.618863 28731 tablet_service.cc:1514] Processing DeleteTablet for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:12 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:55990
I20260619 04:44:12.619133 28597 tablet_service.cc:1514] Processing DeleteTablet for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:12 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:41530
I20260619 04:44:12.619131 28463 tablet_service.cc:1514] Processing DeleteTablet for tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:12 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:48886
I20260619 04:44:12.624044 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28400
I20260619 04:44:12.631894 28840 tablet_replica.cc:330] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: stopping tablet replica
I20260619 04:44:12.632472 28840 raft_consensus.cc:2229] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:12.633083 28840 raft_consensus.cc:2258] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:12.635862 28840 ts_tablet_manager.cc:1905] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:12.644968 28840 ts_tablet_manager.cc:1918] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:12.645167 28840 log.cc:1196] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/b6c3b3eeca2f4b34bafba67a8b27a0f2
I20260619 04:44:12.645776 28840 ts_tablet_manager.cc:1939] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P e752900fb6234a5a968ee5ea9ab687a0: Deleting consensus metadata
I20260619 04:44:12.648017 28323 catalog_manager.cc:4841] TS e752900fb6234a5a968ee5ea9ab687a0 (127.9.224.67:40279): tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 (table test-table [id=39eb0998055248e48f97efe04362332c]) successfully deleted
I20260619 04:44:12.649299 28841 tablet_replica.cc:330] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: stopping tablet replica
I20260619 04:44:12.649799 28841 raft_consensus.cc:2229] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:44:12.650612 28841 raft_consensus.cc:2258] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:12.653051 28841 ts_tablet_manager.cc:1905] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:12.656320 28842 tablet_replica.cc:330] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: stopping tablet replica
I20260619 04:44:12.656792 28842 raft_consensus.cc:2229] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:12.657352 28842 raft_consensus.cc:2258] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:12.660105 28842 ts_tablet_manager.cc:1905] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 04:44:12 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:44:12.662863 28841 ts_tablet_manager.cc:1918] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:12.663039 28841 log.cc:1196] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/b6c3b3eeca2f4b34bafba67a8b27a0f2
I20260619 04:44:12.663623 28841 ts_tablet_manager.cc:1939] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P b6b75764a6d741e0b0e29177bbb5fa00: Deleting consensus metadata
I20260619 04:44:12.665604 28323 catalog_manager.cc:4841] TS b6b75764a6d741e0b0e29177bbb5fa00 (127.9.224.66:33427): tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 (table test-table [id=39eb0998055248e48f97efe04362332c]) successfully deleted
I20260619 04:44:12.669099 28842 ts_tablet_manager.cc:1918] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:12.669355 28842 log.cc:1196] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/b6c3b3eeca2f4b34bafba67a8b27a0f2
I20260619 04:44:12.669852 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.625887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48896 (local address 127.9.224.65:43199)
0619 04:44:12.626167 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.626175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.648559 (+ 22384us) server_negotiation.cc:407] Connection header received
0619 04:44:12.648754 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.648762 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.648865 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.648972 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:12.651103 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.652313 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.654258 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.654904 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.655005 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.662889 (+ 7884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:12.662906 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:12.662925 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:12.662999 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:12.666810 (+ 3811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.667574 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.667581 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.667583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.667774 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.668178 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.668185 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.668193 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.668542 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:12.668899 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.669215 (+ 316us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.669455 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260619 04:44:12.669993 28842 ts_tablet_manager.cc:1939] T b6c3b3eeca2f4b34bafba67a8b27a0f2 P 95290525baee4511b596ba3b5cf69f5b: Deleting consensus metadata
I20260619 04:44:12.670531 28523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:12.767848 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28400
I20260619 04:44:12.768090 28326 catalog_manager.cc:4841] TS 95290525baee4511b596ba3b5cf69f5b (127.9.224.65:43199): tablet b6c3b3eeca2f4b34bafba67a8b27a0f2 (table test-table [id=39eb0998055248e48f97efe04362332c]) successfully deleted
I20260619 04:44:12.786149 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28534
Jun 19 04:44:12 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:44:12.804880 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.786996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.9.224.66:33427)
0619 04:44:12.787207 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.787214 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.787237 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:44:12.787371 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.787377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.787498 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.787611 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:12.789014 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.790510 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.791941 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.792721 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.792876 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.797826 (+ 4950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:12.797841 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:12.797858 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:12.797903 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:12.801486 (+ 3583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.802420 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.802428 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.802430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.802616 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.803057 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.803070 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.803083 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.803491 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:12.803858 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.804243 (+ 385us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.804503 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260619 04:44:12.805732 28657 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:12.923640 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28534
I20260619 04:44:12.942909 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28668
Jun 19 04:44:12 dist-test-slave-9dgf krb5kdc[28294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:44:12.958961 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:12.943791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56004 (local address 127.9.224.67:40279)
0619 04:44:12.943980 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:12.943988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:12.944051 (+ 63us) server_negotiation.cc:407] Connection header received
0619 04:44:12.944274 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:12.944280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:12.944366 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:12.944475 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:12.945867 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.946713 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.948029 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:12.948422 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:12.948559 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:12.953219 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:12.953235 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:12.953252 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:12.953309 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:12.956213 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.956867 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.956874 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.956876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.957009 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:12.957349 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:12.957353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:12.957355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:12.957707 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:12.957913 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:12.958380 (+ 467us) server_negotiation.cc:299] Negotiation successful
0619 04:44:12.958578 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:44:12.959640 28791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:13.051483 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28668
I20260619 04:44:13.068496 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28307
I20260619 04:44:13.069792 28369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:13.182206 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28307
2026-06-19T04:44:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4625 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-06-19T04:44:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:13Z Disabled control of system clock
I20260619 04:44:13.263322 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36237
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 04:44:13.603648 28851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:13.603974 28851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:13.604108 28851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:13.612044 28851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:13.612170 28851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:13.612236 28851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:13.612325 28851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:13.612401 28851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:13.622150 28851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36237
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:13.623569 28851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:13.625507 28851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:13.637745 28859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:13.637807 28857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:13.638517 28856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:13.638593 28851 server_base.cc:1034] running on GCE node
I20260619 04:44:13.639401 28851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:13.640847 28851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:13.642066 28851 hybrid_clock.cc:648] HybridClock initialized: now 1781844253641987 us; error 67 us; skew 500 ppm
I20260619 04:44:13.642473 28851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:13.644780 28851 webserver.cc:460] Webserver started at http://127.9.224.126:43229/ using document root <none> and password file <none>
I20260619 04:44:13.645483 28851 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:13.645572 28851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:13.645885 28851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:13.648905 28851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "280653c4f5e84ba38ecba3668f616128"
format_stamp: "Formatted at 2026-06-19 04:44:13 on dist-test-slave-9dgf"
server_key: "34c514a72894338fd7de059a78a3c88f"
server_key_iv: "1e8aa166281c69c1173969c1b59dbed2"
server_key_version: "encryptionkey@0"
I20260619 04:44:13.649788 28851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "280653c4f5e84ba38ecba3668f616128"
format_stamp: "Formatted at 2026-06-19 04:44:13 on dist-test-slave-9dgf"
server_key: "34c514a72894338fd7de059a78a3c88f"
server_key_iv: "1e8aa166281c69c1173969c1b59dbed2"
server_key_version: "encryptionkey@0"
I20260619 04:44:13.655857 28851 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260619 04:44:13.660295 28865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:13.661875 28851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:44:13.662122 28851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "280653c4f5e84ba38ecba3668f616128"
format_stamp: "Formatted at 2026-06-19 04:44:13 on dist-test-slave-9dgf"
server_key: "34c514a72894338fd7de059a78a3c88f"
server_key_iv: "1e8aa166281c69c1173969c1b59dbed2"
server_key_version: "encryptionkey@0"
I20260619 04:44:13.662456 28851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:13.684295 28851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:13.685264 28851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:13.685590 28851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:13.704717 28851 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36237
I20260619 04:44:13.704736 28916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36237 every 8 connection(s)
I20260619 04:44:13.706157 28851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:13.709385 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28851
I20260619 04:44:13.709578 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:13.710033 10113 external_mini_cluster.cc:1428] Setting key 1eef3e8d02be19a5fdf42fb05289e2a5
I20260619 04:44:13.710273 28917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:13.724270 28917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128: Bootstrap starting.
I20260619 04:44:13.724550 28920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:13.712055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35702 (local address 127.9.224.126:36237)
0619 04:44:13.713109 (+ 1054us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:13.713120 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:13.713163 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:44:13.714936 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:13.714960 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:13.715431 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:13.715778 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:13.716422 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:13.717776 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:13.719618 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:13.720588 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:13.720754 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:13.722032 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:13.722040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:13.722053 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:13.722718 (+ 665us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:13.722793 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:13.722814 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:13.722902 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:13.723137 (+ 235us) server_negotiation.cc:299] Negotiation successful
0619 04:44:13.723491 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":379,"threads_started":1}
I20260619 04:44:13.728039 28917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:13.729120 28917 log.cc:824] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:13.731973 28917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128: No bootstrap required, opened a new log
I20260619 04:44:13.739424 28917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "280653c4f5e84ba38ecba3668f616128" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36237 } }
I20260619 04:44:13.739838 28917 raft_consensus.cc:374] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:13.739946 28917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280653c4f5e84ba38ecba3668f616128, State: Initialized, Role: FOLLOWER
I20260619 04:44:13.740556 28917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "280653c4f5e84ba38ecba3668f616128" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36237 } }
I20260619 04:44:13.740808 28917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:13.740953 28917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:13.741151 28917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:13.743428 28917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "280653c4f5e84ba38ecba3668f616128" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36237 } }
I20260619 04:44:13.743986 28917 leader_election.cc:302] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 280653c4f5e84ba38ecba3668f616128; no voters:
I20260619 04:44:13.744673 28917 leader_election.cc:288] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:13.744961 28922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:13.745779 28922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [term 1 LEADER]: Becoming Leader. State: Replica: 280653c4f5e84ba38ecba3668f616128, State: Running, Role: LEADER
I20260619 04:44:13.746402 28922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "280653c4f5e84ba38ecba3668f616128" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36237 } }
I20260619 04:44:13.747052 28917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:13.750139 28923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "280653c4f5e84ba38ecba3668f616128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "280653c4f5e84ba38ecba3668f616128" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36237 } } }
I20260619 04:44:13.750147 28924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 280653c4f5e84ba38ecba3668f616128. Latest consensus state: current_term: 1 leader_uuid: "280653c4f5e84ba38ecba3668f616128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "280653c4f5e84ba38ecba3668f616128" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36237 } } }
I20260619 04:44:13.750916 28923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:13.750942 28924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:13.756268 28928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:13.762188 28928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:13.771138 28928 catalog_manager.cc:1347] Generated new cluster ID: d192d6541bf64edc8f669b2d0ac4b4d7
I20260619 04:44:13.771288 28928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:13.780640 28928 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:13.781912 28928 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:13.789824 28928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128: Generated new TSK 0
I20260619 04:44:13.790944 28928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:13.805222 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36237
--builtin_ntp_servers=127.9.224.84:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 04:44:14.143534 28941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:14.143867 28941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:14.144040 28941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:14.151530 28941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:14.151672 28941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:14.151860 28941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:44:14.161262 28941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:14.162628 28941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:14.164443 28941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:14.177831 28949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:14.177870 28946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:14.177942 28947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:14.183825 28941 server_base.cc:1034] running on GCE node
I20260619 04:44:14.184468 28941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:14.185416 28941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:14.186625 28941 hybrid_clock.cc:648] HybridClock initialized: now 1781844254186578 us; error 42 us; skew 500 ppm
I20260619 04:44:14.186926 28941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:14.189417 28941 webserver.cc:460] Webserver started at http://127.9.224.65:34803/ using document root <none> and password file <none>
I20260619 04:44:14.190138 28941 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:14.190223 28941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:14.190613 28941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:14.193459 28941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "ea81b9625b204b9db9af265e4bc2b304"
format_stamp: "Formatted at 2026-06-19 04:44:14 on dist-test-slave-9dgf"
server_key: "54be149d0dfb3732c055214ea1565515"
server_key_iv: "ee931bd758427e5a171ec17bc3ad3c95"
server_key_version: "encryptionkey@0"
I20260619 04:44:14.194185 28941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "ea81b9625b204b9db9af265e4bc2b304"
format_stamp: "Formatted at 2026-06-19 04:44:14 on dist-test-slave-9dgf"
server_key: "54be149d0dfb3732c055214ea1565515"
server_key_iv: "ee931bd758427e5a171ec17bc3ad3c95"
server_key_version: "encryptionkey@0"
I20260619 04:44:14.199381 28941 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:44:14.202767 28955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:14.204159 28941 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 04:44:14.204305 28941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "ea81b9625b204b9db9af265e4bc2b304"
format_stamp: "Formatted at 2026-06-19 04:44:14 on dist-test-slave-9dgf"
server_key: "54be149d0dfb3732c055214ea1565515"
server_key_iv: "ee931bd758427e5a171ec17bc3ad3c95"
server_key_version: "encryptionkey@0"
I20260619 04:44:14.204496 28941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:14.217056 28941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:14.217826 28941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:14.218087 28941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:14.219169 28941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:14.220590 28941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:14.220674 28941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:14.220749 28941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:14.220804 28941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:14.255362 28941 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:40591
I20260619 04:44:14.255451 29067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:40591 every 8 connection(s)
I20260619 04:44:14.256852 28941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:44:14.260886 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 28941
I20260619 04:44:14.261061 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:44:14.261656 10113 external_mini_cluster.cc:1428] Setting key 7e943eb727d11d18ea7f0b648b7c7f3f
I20260619 04:44:14.264921 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36237
--builtin_ntp_servers=127.9.224.84:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 04:44:14.271905 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:14.259485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:41065 (local address 127.9.224.126:36237)
0619 04:44:14.259958 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:14.259962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:14.261425 (+ 1463us) server_negotiation.cc:407] Connection header received
0619 04:44:14.263718 (+ 2293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:14.263724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:14.263808 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:14.263898 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:14.265437 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.266192 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.268790 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.269237 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.269348 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:14.271107 (+ 1759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:14.271112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:14.271115 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:14.271135 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:14.271201 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:14.271214 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:14.271290 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:14.271557 (+ 267us) server_negotiation.cc:299] Negotiation successful
0619 04:44:14.271642 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":267,"threads_started":1}
I20260619 04:44:14.273447 29071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:14.260148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36237 (local address 127.9.224.65:41065)
0619 04:44:14.261249 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:14.261300 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:14.263411 (+ 2111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:14.264200 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:14.264212 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:14.264344 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:14.265252 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:14.265280 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.266414 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.266421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:14.268597 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:14.268616 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.269481 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.269490 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:14.269845 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:14.270714 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:14.270720 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:14.270779 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:14.270891 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:14.271320 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:14.271333 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:14.271344 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 04:44:14.271539 (+ 195us) client_negotiation.cc:240] Negotiation successful
0619 04:44:14.271995 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":298,"threads_started":1}
I20260619 04:44:14.275411 29068 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36237
I20260619 04:44:14.275789 29068 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:14.276559 29068 heartbeater.cc:511] Master 127.9.224.126:36237 requested a full tablet report, sending...
I20260619 04:44:14.279094 28882 ts_manager.cc:194] Registered new tserver with Master: ea81b9625b204b9db9af265e4bc2b304 (127.9.224.65:40591)
I20260619 04:44:14.281329 28882 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.65:41065
W20260619 04:44:14.606093 29072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:14.606446 29072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:14.606541 29072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:14.614003 29072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:14.614118 29072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:14.614306 29072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:44:14.624039 29072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:14.625517 29072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:14.627369 29072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:14.640936 29077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:14.640861 29078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:14.640897 29080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:14.642071 29072 server_base.cc:1034] running on GCE node
I20260619 04:44:14.642828 29072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:14.644044 29072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:14.645336 29072 hybrid_clock.cc:648] HybridClock initialized: now 1781844254645253 us; error 65 us; skew 500 ppm
I20260619 04:44:14.645722 29072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:14.648463 29072 webserver.cc:460] Webserver started at http://127.9.224.66:37931/ using document root <none> and password file <none>
I20260619 04:44:14.649230 29072 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:14.649370 29072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:14.649696 29072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:14.652654 29072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "38caf84ba4a947b8aa70507d2b300630"
format_stamp: "Formatted at 2026-06-19 04:44:14 on dist-test-slave-9dgf"
server_key: "088b9f2c7efc5f75e2bc26e5c6a33394"
server_key_iv: "ac887957600b248b2f8a367c0a673257"
server_key_version: "encryptionkey@0"
I20260619 04:44:14.653452 29072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "38caf84ba4a947b8aa70507d2b300630"
format_stamp: "Formatted at 2026-06-19 04:44:14 on dist-test-slave-9dgf"
server_key: "088b9f2c7efc5f75e2bc26e5c6a33394"
server_key_iv: "ac887957600b248b2f8a367c0a673257"
server_key_version: "encryptionkey@0"
I20260619 04:44:14.659041 29072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 04:44:14.662741 29086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:14.664201 29072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:44:14.664412 29072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "38caf84ba4a947b8aa70507d2b300630"
format_stamp: "Formatted at 2026-06-19 04:44:14 on dist-test-slave-9dgf"
server_key: "088b9f2c7efc5f75e2bc26e5c6a33394"
server_key_iv: "ac887957600b248b2f8a367c0a673257"
server_key_version: "encryptionkey@0"
I20260619 04:44:14.664649 29072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:14.676077 29072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:14.676936 29072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:14.677255 29072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:14.678591 29072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:14.680475 29072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:14.680629 29072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:14.680781 29072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:14.680877 29072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:14.716188 29072 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:46079
I20260619 04:44:14.716228 29198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:46079 every 8 connection(s)
I20260619 04:44:14.717525 29072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:44:14.725926 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29072
I20260619 04:44:14.726107 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:44:14.726637 10113 external_mini_cluster.cc:1428] Setting key 22a1b50654d6755fc8960ccfec8919be
I20260619 04:44:14.729486 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36237
--builtin_ntp_servers=127.9.224.84:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 04:44:14.731258 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:14.720309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:43969 (local address 127.9.224.126:36237)
0619 04:44:14.720488 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:14.720493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:14.722105 (+ 1612us) server_negotiation.cc:407] Connection header received
0619 04:44:14.723977 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:14.723983 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:14.724076 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:14.724201 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:14.725289 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.726347 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.728201 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.728662 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.728794 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:14.730324 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:14.730334 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:14.730342 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:14.730368 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:14.730413 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:14.730432 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:14.730526 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:14.730743 (+ 217us) server_negotiation.cc:299] Negotiation successful
0619 04:44:14.730860 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:44:14.732159 29201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:14.720904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36237 (local address 127.9.224.66:43969)
0619 04:44:14.721935 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:14.721973 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:14.723692 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:14.724436 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:14.724445 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:14.724547 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:14.725124 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:14.725140 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.726513 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.726517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:14.728062 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:14.728075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:14.728921 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:14.728926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:14.729151 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:14.729941 (+ 790us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:14.729944 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:14.729987 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:14.730074 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:14.730531 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:14.730539 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:14.730545 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 04:44:14.730722 (+ 177us) client_negotiation.cc:240] Negotiation successful
0619 04:44:14.731030 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":320,"threads_started":1}
I20260619 04:44:14.733664 29199 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36237
I20260619 04:44:14.734009 29199 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:14.734977 29199 heartbeater.cc:511] Master 127.9.224.126:36237 requested a full tablet report, sending...
I20260619 04:44:14.736652 28882 ts_manager.cc:194] Registered new tserver with Master: 38caf84ba4a947b8aa70507d2b300630 (127.9.224.66:46079)
I20260619 04:44:14.737962 28882 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.66:43969
W20260619 04:44:15.063383 29202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:15.063676 29202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:15.063807 29202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:15.071375 29202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:15.071482 29202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:15.071645 29202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:44:15.080960 29202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:15.082309 29202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:15.084107 29202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:15.097638 29210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:15.097595 29207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:15.097681 29208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:15.098902 29202 server_base.cc:1034] running on GCE node
I20260619 04:44:15.099663 29202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:15.100797 29202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:15.101998 29202 hybrid_clock.cc:648] HybridClock initialized: now 1781844255101946 us; error 46 us; skew 500 ppm
I20260619 04:44:15.102403 29202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:15.104810 29202 webserver.cc:460] Webserver started at http://127.9.224.67:33829/ using document root <none> and password file <none>
I20260619 04:44:15.105520 29202 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:15.105608 29202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:15.105923 29202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:15.109019 29202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "a290ac87e274494b9397025d136e9de8"
format_stamp: "Formatted at 2026-06-19 04:44:15 on dist-test-slave-9dgf"
server_key: "644842241ae9f483ec33c0b354daa6bb"
server_key_iv: "045ecb7deef682622f1d2d8a7025d47c"
server_key_version: "encryptionkey@0"
I20260619 04:44:15.109835 29202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "a290ac87e274494b9397025d136e9de8"
format_stamp: "Formatted at 2026-06-19 04:44:15 on dist-test-slave-9dgf"
server_key: "644842241ae9f483ec33c0b354daa6bb"
server_key_iv: "045ecb7deef682622f1d2d8a7025d47c"
server_key_version: "encryptionkey@0"
I20260619 04:44:15.114861 29202 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:44:15.118310 29216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:15.120148 29202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:15.120314 29202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "a290ac87e274494b9397025d136e9de8"
format_stamp: "Formatted at 2026-06-19 04:44:15 on dist-test-slave-9dgf"
server_key: "644842241ae9f483ec33c0b354daa6bb"
server_key_iv: "045ecb7deef682622f1d2d8a7025d47c"
server_key_version: "encryptionkey@0"
I20260619 04:44:15.120528 29202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:15.148861 29202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:15.149748 29202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:15.150084 29202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:15.151139 29202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:15.152659 29202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:15.152776 29202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:15.152902 29202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:15.152989 29202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:15.187305 29202 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:35271
I20260619 04:44:15.187397 29328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:35271 every 8 connection(s)
I20260619 04:44:15.188647 29202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:44:15.198932 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29202
I20260619 04:44:15.199105 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:44:15.199545 10113 external_mini_cluster.cc:1428] Setting key 4e62680e30c3dea9c619ea997ef08c91
I20260619 04:44:15.201865 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.191331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:40763 (local address 127.9.224.126:36237)
0619 04:44:15.191543 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.191549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.193015 (+ 1466us) server_negotiation.cc:407] Connection header received
0619 04:44:15.195070 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.195076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.195174 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.195275 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:15.196306 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.197125 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.198757 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.199282 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.199417 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.200925 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:15.200930 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:15.200935 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:15.200956 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:15.200995 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:15.201011 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:15.201108 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.201488 (+ 380us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.201588 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 04:44:15.203281 29331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.191934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36237 (local address 127.9.224.67:40763)
0619 04:44:15.192869 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.192906 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:15.194782 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:15.195462 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:15.195470 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:15.195563 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:15.196135 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.196151 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.197264 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.197268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.198568 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.198579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.199509 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.199516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.199790 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.200558 (+ 768us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:15.200560 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:15.200600 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:15.200691 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:15.201196 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:15.201212 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:15.201221 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 04:44:15.201462 (+ 241us) client_negotiation.cc:240] Negotiation successful
0619 04:44:15.201948 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":292,"threads_started":1}
I20260619 04:44:15.204810 29329 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36237
I20260619 04:44:15.205124 29329 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:15.205883 29329 heartbeater.cc:511] Master 127.9.224.126:36237 requested a full tablet report, sending...
I20260619 04:44:15.207374 28882 ts_manager.cc:194] Registered new tserver with Master: a290ac87e274494b9397025d136e9de8 (127.9.224.67:35271)
I20260619 04:44:15.208181 28882 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.67:40763
I20260619 04:44:15.215186 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:44:15.225694 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.219461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.9.224.126:36237)
0619 04:44:15.219768 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.219773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.220181 (+ 408us) server_negotiation.cc:407] Connection header received
0619 04:44:15.220372 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.220376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.220453 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.220541 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:15.221165 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.221912 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.223408 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.223827 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.223928 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.225032 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:15.225036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:15.225040 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:15.225057 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:15.225087 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:15.225098 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:15.225217 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.225410 (+ 193us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.225458 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260619 04:44:15.229882 28882 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:44:15.237064 28882 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:44:15.275926 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.249271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46079 (local address 127.0.0.1:34458)
0619 04:44:15.250086 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.250135 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:15.250344 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:15.266993 (+ 16649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:15.267001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:15.267035 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:15.267588 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.267605 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.269998 (+ 2393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.270003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.272806 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.272819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.274457 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.274464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.274765 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.275147 (+ 382us) client_negotiation.cc:769] Sending connection context
0619 04:44:15.275340 (+ 193us) client_negotiation.cc:240] Negotiation successful
0619 04:44:15.275540 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":65,"thread_start_us":597,"threads_started":1}
I20260619 04:44:15.275906 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.249417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.9.224.66:46079)
0619 04:44:15.266106 (+ 16689us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.266117 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.266158 (+ 41us) server_negotiation.cc:407] Connection header received
0619 04:44:15.266371 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.266382 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.266685 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.267818 (+ 1133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:15.268204 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.269862 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.273005 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.274150 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.274913 (+ 763us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.275163 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.275373 (+ 210us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.275547 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16515,"thread_start_us":16390,"threads_started":1}
I20260619 04:44:15.277047 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.249748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:35271 (local address 127.0.0.1:49130)
0619 04:44:15.266519 (+ 16771us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.266541 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:15.266701 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:15.267764 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:15.267768 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:15.267804 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:15.268279 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.268293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.270862 (+ 2569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.270868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.272429 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.272442 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.274396 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.274406 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.274738 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.276399 (+ 1661us) client_negotiation.cc:769] Sending connection context
0619 04:44:15.276493 (+ 94us) client_negotiation.cc:240] Negotiation successful
0619 04:44:15.276638 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16616,"mutex_wait_us":119,"thread_start_us":16429,"threads_started":1}
I20260619 04:44:15.277570 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.250763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55894)
0619 04:44:15.268818 (+ 18055us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.268834 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:15.268975 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:15.269562 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:15.269567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:15.269593 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:15.270669 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.270688 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.272721 (+ 2033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.272730 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.275205 (+ 2475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.275215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.276747 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.276754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.276962 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.276998 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 04:44:15.277081 (+ 83us) client_negotiation.cc:240] Negotiation successful
0619 04:44:15.277209 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17929,"mutex_wait_us":21,"thread_start_us":17793,"threads_started":1}
I20260619 04:44:15.277668 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.250077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49130 (local address 127.9.224.67:35271)
0619 04:44:15.260679 (+ 10602us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.260693 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.266868 (+ 6175us) server_negotiation.cc:407] Connection header received
0619 04:44:15.266986 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.266994 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.267248 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.267463 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:15.268491 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.270088 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.272615 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.274137 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.274602 (+ 465us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.274884 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.277080 (+ 2196us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.277259 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10356,"thread_start_us":15457,"threads_started":1}
I20260619 04:44:15.278558 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.251415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.9.224.65:40591)
0619 04:44:15.268380 (+ 16965us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.268393 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.268944 (+ 551us) server_negotiation.cc:407] Connection header received
0619 04:44:15.269140 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.269146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.269359 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.269575 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:15.270933 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.272582 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.275390 (+ 2808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.276559 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.276682 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.276951 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.278004 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.278172 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16715,"thread_start_us":16589,"threads_started":1}
I20260619 04:44:15.280346 29134 tablet_service.cc:1467] Processing CreateTablet for tablet dd58f19ded484347b8ba1f0e12e9c3ea (DEFAULT_TABLE table=test-table [id=d5db8d1814854224822f860221e6be7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:15.281535 29134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd58f19ded484347b8ba1f0e12e9c3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:15.281720 29264 tablet_service.cc:1467] Processing CreateTablet for tablet dd58f19ded484347b8ba1f0e12e9c3ea (DEFAULT_TABLE table=test-table [id=d5db8d1814854224822f860221e6be7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:15.282209 29003 tablet_service.cc:1467] Processing CreateTablet for tablet dd58f19ded484347b8ba1f0e12e9c3ea (DEFAULT_TABLE table=test-table [id=d5db8d1814854224822f860221e6be7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:15.283239 29264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd58f19ded484347b8ba1f0e12e9c3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:15.283584 29003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd58f19ded484347b8ba1f0e12e9c3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:15.284741 29068 heartbeater.cc:503] Master 127.9.224.126:36237 was elected leader, sending a full tablet report...
I20260619 04:44:15.293758 29347 tablet_bootstrap.cc:492] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Bootstrap starting.
I20260619 04:44:15.297601 29348 tablet_bootstrap.cc:492] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Bootstrap starting.
I20260619 04:44:15.297890 29347 tablet_bootstrap.cc:654] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:15.299402 29347 log.cc:824] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:15.300582 29349 tablet_bootstrap.cc:492] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Bootstrap starting.
I20260619 04:44:15.301748 29348 tablet_bootstrap.cc:654] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:15.302922 29348 log.cc:824] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:15.303941 29349 tablet_bootstrap.cc:654] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:15.304183 29347 tablet_bootstrap.cc:492] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: No bootstrap required, opened a new log
I20260619 04:44:15.304479 29347 ts_tablet_manager.cc:1397] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260619 04:44:15.305044 29349 log.cc:824] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:15.306094 29348 tablet_bootstrap.cc:492] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: No bootstrap required, opened a new log
I20260619 04:44:15.306380 29348 ts_tablet_manager.cc:1397] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 04:44:15.307880 29349 tablet_bootstrap.cc:492] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: No bootstrap required, opened a new log
I20260619 04:44:15.308141 29349 ts_tablet_manager.cc:1397] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260619 04:44:15.315215 29349 raft_consensus.cc:348] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.315263 29347 raft_consensus.cc:348] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.315613 29349 raft_consensus.cc:374] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:15.315704 29349 raft_consensus.cc:729] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea81b9625b204b9db9af265e4bc2b304, State: Initialized, Role: FOLLOWER
I20260619 04:44:15.315707 29347 raft_consensus.cc:374] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:15.315815 29347 raft_consensus.cc:729] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38caf84ba4a947b8aa70507d2b300630, State: Initialized, Role: FOLLOWER
I20260619 04:44:15.316378 29349 consensus_queue.cc:260] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.316536 29347 consensus_queue.cc:260] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.316975 29348 raft_consensus.cc:348] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.317548 29348 raft_consensus.cc:374] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:15.317679 29348 raft_consensus.cc:729] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a290ac87e274494b9397025d136e9de8, State: Initialized, Role: FOLLOWER
I20260619 04:44:15.318403 29349 ts_tablet_manager.cc:1428] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Time spent starting tablet: real 0.010s user 0.009s sys 0.001s
I20260619 04:44:15.318665 29348 consensus_queue.cc:260] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.320220 29199 heartbeater.cc:503] Master 127.9.224.126:36237 was elected leader, sending a full tablet report...
I20260619 04:44:15.321264 29347 ts_tablet_manager.cc:1428] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260619 04:44:15.322191 29329 heartbeater.cc:503] Master 127.9.224.126:36237 was elected leader, sending a full tablet report...
I20260619 04:44:15.323185 29348 ts_tablet_manager.cc:1428] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
W20260619 04:44:15.440471 29330 tablet.cc:2369] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:15.469722 29200 tablet.cc:2369] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:15.474206 29355 raft_consensus.cc:482] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:15.474550 29355 raft_consensus.cc:504] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.476253 29355 leader_election.cc:288] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38caf84ba4a947b8aa70507d2b300630 (127.9.224.66:46079), ea81b9625b204b9db9af265e4bc2b304 (127.9.224.65:40591)
I20260619 04:44:15.482069 29331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.476583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:46079 (local address 127.9.224.67:36573)
0619 04:44:15.476786 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.476810 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:15.476932 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:15.477366 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:15.477371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:15.477402 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:15.477669 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.477685 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.478761 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.478766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.480102 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.480114 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.481253 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.481258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.481481 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.481505 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 04:44:15.481608 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 04:44:15.481766 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":38}
I20260619 04:44:15.482050 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.476717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:36573 (local address 127.9.224.66:46079)
0619 04:44:15.476971 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.476980 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.477004 (+ 24us) server_negotiation.cc:407] Connection header received
0619 04:44:15.477082 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.477087 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.477199 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.477306 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:15.477851 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.478619 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.480262 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.481088 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.481260 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.481335 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.481636 (+ 301us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.481766 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:44:15.483206 29356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.477105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.9.224.67:46867)
0619 04:44:15.477970 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.477985 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:15.478120 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:15.478489 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:15.478493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:15.478516 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:15.478846 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.478854 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.479858 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.479863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.481302 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:15.481313 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.482538 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.482546 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:15.482721 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.482753 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 04:44:15.482852 (+ 99us) client_negotiation.cc:240] Negotiation successful
0619 04:44:15.482938 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"mutex_wait_us":3,"thread_start_us":545,"threads_started":1}
I20260619 04:44:15.483269 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.477461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:46867 (local address 127.9.224.65:40591)
0619 04:44:15.477667 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.477672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.478074 (+ 402us) server_negotiation.cc:407] Connection header received
0619 04:44:15.478294 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.478298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.478375 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.478469 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:15.479002 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.479703 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.481481 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.482385 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.482530 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.482577 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.482899 (+ 322us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.483032 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 04:44:15.483350 29154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd58f19ded484347b8ba1f0e12e9c3ea" candidate_uuid: "a290ac87e274494b9397025d136e9de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38caf84ba4a947b8aa70507d2b300630" is_pre_election: true
I20260619 04:44:15.483933 29154 raft_consensus.cc:2454] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a290ac87e274494b9397025d136e9de8 in term 0.
I20260619 04:44:15.484408 29023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd58f19ded484347b8ba1f0e12e9c3ea" candidate_uuid: "a290ac87e274494b9397025d136e9de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea81b9625b204b9db9af265e4bc2b304" is_pre_election: true
I20260619 04:44:15.484609 29217 leader_election.cc:302] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38caf84ba4a947b8aa70507d2b300630, a290ac87e274494b9397025d136e9de8; no voters:
I20260619 04:44:15.485005 29023 raft_consensus.cc:2454] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a290ac87e274494b9397025d136e9de8 in term 0.
I20260619 04:44:15.485038 29355 raft_consensus.cc:2781] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:44:15.485210 29355 raft_consensus.cc:482] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:44:15.485347 29355 raft_consensus.cc:3037] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:15.487926 29355 raft_consensus.cc:504] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.488559 29355 leader_election.cc:288] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [CANDIDATE]: Term 1 election: Requested vote from peers 38caf84ba4a947b8aa70507d2b300630 (127.9.224.66:46079), ea81b9625b204b9db9af265e4bc2b304 (127.9.224.65:40591)
I20260619 04:44:15.489064 29154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd58f19ded484347b8ba1f0e12e9c3ea" candidate_uuid: "a290ac87e274494b9397025d136e9de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38caf84ba4a947b8aa70507d2b300630"
I20260619 04:44:15.489118 29023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd58f19ded484347b8ba1f0e12e9c3ea" candidate_uuid: "a290ac87e274494b9397025d136e9de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea81b9625b204b9db9af265e4bc2b304"
I20260619 04:44:15.489286 29154 raft_consensus.cc:3037] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:15.489367 29023 raft_consensus.cc:3037] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:15.491652 29023 raft_consensus.cc:2454] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a290ac87e274494b9397025d136e9de8 in term 1.
I20260619 04:44:15.491935 29154 raft_consensus.cc:2454] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a290ac87e274494b9397025d136e9de8 in term 1.
I20260619 04:44:15.492107 29217 leader_election.cc:302] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a290ac87e274494b9397025d136e9de8, ea81b9625b204b9db9af265e4bc2b304; no voters:
I20260619 04:44:15.492453 29355 raft_consensus.cc:2781] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:15.492990 29355 raft_consensus.cc:686] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 1 LEADER]: Becoming Leader. State: Replica: a290ac87e274494b9397025d136e9de8, State: Running, Role: LEADER
I20260619 04:44:15.493583 29355 consensus_queue.cc:237] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } }
I20260619 04:44:15.498703 28882 catalog_manager.cc:5495] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a290ac87e274494b9397025d136e9de8 (127.9.224.67). New cstate: current_term: 1 leader_uuid: "a290ac87e274494b9397025d136e9de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a290ac87e274494b9397025d136e9de8" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 35271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 } health_report { overall_health: UNKNOWN } } }
W20260619 04:44:15.509382 29069 tablet.cc:2369] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:15.518872 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.513347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49138 (local address 127.9.224.67:35271)
0619 04:44:15.513535 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.513540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.513623 (+ 83us) server_negotiation.cc:407] Connection header received
0619 04:44:15.513823 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.513827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.513903 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.514030 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:44:15.514495 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.515217 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.516749 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.517145 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.517248 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.517699 (+ 451us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:44:15.518360 (+ 661us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:44:15.518500 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.518645 (+ 145us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.518683 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:44:15.527451 29023 raft_consensus.cc:1261] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 1 FOLLOWER]: Refusing update from remote peer a290ac87e274494b9397025d136e9de8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:15.527451 29154 raft_consensus.cc:1261] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 1 FOLLOWER]: Refusing update from remote peer a290ac87e274494b9397025d136e9de8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:15.528563 29357 consensus_queue.cc:1035] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38caf84ba4a947b8aa70507d2b300630" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:15.529100 29355 consensus_queue.cc:1035] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea81b9625b204b9db9af265e4bc2b304" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:15.543205 29361 mvcc.cc:205] Tried to move back new op lower bound from 7298434070628700160 to 7298434070506500096. Current Snapshot: MvccSnapshot[applied={T|T < 7298434070628700160}]
I20260619 04:44:15.543583 29362 mvcc.cc:205] Tried to move back new op lower bound from 7298434070628700160 to 7298434070506500096. Current Snapshot: MvccSnapshot[applied={T|T < 7298434070628700160}]
I20260619 04:44:15.556118 28882 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:15.556370 28882 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:15.560122 28882 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 280653c4f5e84ba38ecba3668f616128: Sending DeleteTablet for 3 replicas of tablet dd58f19ded484347b8ba1f0e12e9c3ea
I20260619 04:44:15.561378 29264 tablet_service.cc:1514] Processing DeleteTablet for tablet dd58f19ded484347b8ba1f0e12e9c3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:15 UTC) from {username='slave'} at 127.0.0.1:49130
I20260619 04:44:15.561820 29134 tablet_service.cc:1514] Processing DeleteTablet for tablet dd58f19ded484347b8ba1f0e12e9c3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:15 UTC) from {username='slave'} at 127.0.0.1:34458
I20260619 04:44:15.562425 29370 tablet_replica.cc:330] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: stopping tablet replica
I20260619 04:44:15.562763 29003 tablet_service.cc:1514] Processing DeleteTablet for tablet dd58f19ded484347b8ba1f0e12e9c3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:15 UTC) from {username='slave'} at 127.0.0.1:55894
I20260619 04:44:15.563038 29370 raft_consensus.cc:2229] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:44:15.563956 29370 raft_consensus.cc:2258] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:15.564152 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28941
I20260619 04:44:15.571916 29372 tablet_replica.cc:330] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: stopping tablet replica
I20260619 04:44:15.572454 29372 raft_consensus.cc:2229] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:15.573006 29372 raft_consensus.cc:2258] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:15.573949 29370 ts_tablet_manager.cc:1905] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:15.577289 29372 ts_tablet_manager.cc:1905] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:15.583055 29370 ts_tablet_manager.cc:1918] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:15.583288 29370 log.cc:1196] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/dd58f19ded484347b8ba1f0e12e9c3ea
I20260619 04:44:15.583948 29370 ts_tablet_manager.cc:1939] T dd58f19ded484347b8ba1f0e12e9c3ea P a290ac87e274494b9397025d136e9de8: Deleting consensus metadata
I20260619 04:44:15.584375 29371 tablet_replica.cc:330] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: stopping tablet replica
I20260619 04:44:15.584821 29371 raft_consensus.cc:2229] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:15.585343 29371 raft_consensus.cc:2258] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:15.585862 28868 catalog_manager.cc:4841] TS a290ac87e274494b9397025d136e9de8 (127.9.224.67:35271): tablet dd58f19ded484347b8ba1f0e12e9c3ea (table test-table [id=d5db8d1814854224822f860221e6be7c]) successfully deleted
I20260619 04:44:15.588331 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.566220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55898 (local address 127.9.224.65:40591)
0619 04:44:15.566495 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.566504 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.579553 (+ 13049us) server_negotiation.cc:407] Connection header received
0619 04:44:15.579799 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.579807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.579913 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.580018 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:15.580501 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.581632 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.583810 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.584433 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.584532 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.586428 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:15.586440 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:15.586457 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:15.587342 (+ 885us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:15.587418 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:15.587443 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:15.587537 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.587827 (+ 290us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.587950 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 04:44:15.589064 29372 ts_tablet_manager.cc:1918] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:15.589092 29063 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:15.589251 29372 log.cc:1196] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/dd58f19ded484347b8ba1f0e12e9c3ea
I20260619 04:44:15.591493 29371 ts_tablet_manager.cc:1905] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:15.599207 29371 ts_tablet_manager.cc:1918] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:15.599416 29371 log.cc:1196] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/dd58f19ded484347b8ba1f0e12e9c3ea
I20260619 04:44:15.599992 29371 ts_tablet_manager.cc:1939] T dd58f19ded484347b8ba1f0e12e9c3ea P 38caf84ba4a947b8aa70507d2b300630: Deleting consensus metadata
I20260619 04:44:15.602175 28866 catalog_manager.cc:4841] TS 38caf84ba4a947b8aa70507d2b300630 (127.9.224.66:46079): tablet dd58f19ded484347b8ba1f0e12e9c3ea (table test-table [id=d5db8d1814854224822f860221e6be7c]) successfully deleted
I20260619 04:44:15.683262 29372 ts_tablet_manager.cc:1939] T dd58f19ded484347b8ba1f0e12e9c3ea P ea81b9625b204b9db9af265e4bc2b304: Deleting consensus metadata
I20260619 04:44:15.683317 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28941
I20260619 04:44:15.701731 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29072
W20260619 04:44:15.701853 28866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.224.65:40591 (error 108)
I20260619 04:44:15.705183 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.704705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55912)
0619 04:44:15.704864 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.705023 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260619 04:44:15.705580 28866 catalog_manager.cc:4584] TS ea81b9625b204b9db9af265e4bc2b304 (127.9.224.65:40591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd58f19ded484347b8ba1f0e12e9c3ea: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
I20260619 04:44:15.712338 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.703042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34460 (local address 127.9.224.66:46079)
0619 04:44:15.703228 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.703234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.703269 (+ 35us) server_negotiation.cc:407] Connection header received
0619 04:44:15.703342 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.703348 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.703460 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.703570 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:15.705607 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.706798 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.708674 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.709272 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.709414 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.710657 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:15.710669 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:15.710689 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:15.711479 (+ 790us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:15.711539 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:15.711566 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:15.711689 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.711828 (+ 139us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.711948 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:44:15.713074 29194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:15.759192 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.758679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55928)
0619 04:44:15.758929 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.759032 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260619 04:44:15.760399 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.759975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55938)
0619 04:44:15.760129 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.760222 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260619 04:44:15.821270 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.820643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55944)
0619 04:44:15.820929 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.821050 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260619 04:44:15.822753 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.822313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55960)
0619 04:44:15.822492 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.822595 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260619 04:44:15.827548 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29072
I20260619 04:44:15.852552 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29202
I20260619 04:44:15.860217 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.853450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49154 (local address 127.9.224.67:35271)
0619 04:44:15.853660 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:15.853667 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:15.853689 (+ 22us) server_negotiation.cc:407] Connection header received
0619 04:44:15.853783 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:15.853788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:15.853891 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:15.854007 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:15.854497 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.855375 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.856841 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:15.857310 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:15.857474 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:15.858706 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:15.858715 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:15.858741 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:15.859402 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:15.859454 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:15.859477 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:15.859597 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:15.859749 (+ 152us) server_negotiation.cc:299] Negotiation successful
0619 04:44:15.859861 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:44:15.861003 29324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:15.903780 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.903186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55972)
0619 04:44:15.903441 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.903558 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260619 04:44:15.905002 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:15.904520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55980)
0619 04:44:15.904761 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:15.904863 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260619 04:44:15.985363 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29202
I20260619 04:44:16.006206 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 28851
I20260619 04:44:16.007459 28912 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:16.116390 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:16.115385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:40591 (local address 127.0.0.1:55982)
0619 04:44:16.115896 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:16.116023 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:40591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194}
I20260619 04:44:16.116696 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 28851
2026-06-19T04:44:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2932 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:16 dist-test-slave-9dgf krb5kdc[29381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:16 dist-test-slave-9dgf krb5kdc[29381](info): set up 2 sockets
Jun 19 04:44:16 dist-test-slave-9dgf krb5kdc[29381](info): commencing operation
krb5kdc: starting...
W20260619 04:44:17.286964 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:17 dist-test-slave-9dgf krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:17.555558 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:43919
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:42065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:43919
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:17.906045 29394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:17.906411 29394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:17.906514 29394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:17.914085 29394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:17.914204 29394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:17.914320 29394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:17.914389 29394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:17.914431 29394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:17.924469 29394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:43919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:43919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:17.925760 29394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:17.927032 29394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:17.939495 29399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:17.939464 29402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:17.939740 29400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:17.940486 29394 server_base.cc:1034] running on GCE node
I20260619 04:44:17.941341 29394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:17.942907 29394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:17.944142 29394 hybrid_clock.cc:648] HybridClock initialized: now 1781844257944088 us; error 45 us; skew 500 ppm
I20260619 04:44:17.944489 29394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:17 dist-test-slave-9dgf krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844257, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:17.952917 29394 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:17.954689 29394 webserver.cc:460] Webserver started at http://127.9.224.126:43377/ using document root <none> and password file <none>
I20260619 04:44:17.955463 29394 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:17.955610 29394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:17.955938 29394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:17.959223 29394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "944683358d5e435489bc326343f1113c"
format_stamp: "Formatted at 2026-06-19 04:44:17 on dist-test-slave-9dgf"
server_key: "1139ca926ac0140e9a01737b3738b00b"
server_key_iv: "02582175ec17f5386e9a09ec871a82eb"
server_key_version: "encryptionkey@0"
I20260619 04:44:17.959997 29394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "944683358d5e435489bc326343f1113c"
format_stamp: "Formatted at 2026-06-19 04:44:17 on dist-test-slave-9dgf"
server_key: "1139ca926ac0140e9a01737b3738b00b"
server_key_iv: "02582175ec17f5386e9a09ec871a82eb"
server_key_version: "encryptionkey@0"
I20260619 04:44:17.965494 29394 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:44:17.969209 29409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:17.970817 29394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 04:44:17.971002 29394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "944683358d5e435489bc326343f1113c"
format_stamp: "Formatted at 2026-06-19 04:44:17 on dist-test-slave-9dgf"
server_key: "1139ca926ac0140e9a01737b3738b00b"
server_key_iv: "02582175ec17f5386e9a09ec871a82eb"
server_key_version: "encryptionkey@0"
I20260619 04:44:17.971217 29394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:17.986529 29394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:17.991096 29394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:17.991392 29394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:18.010353 29394 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:43919
I20260619 04:44:18.010385 29460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:43919 every 8 connection(s)
I20260619 04:44:18.011795 29394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:18.015774 29461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:18.022166 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29394
I20260619 04:44:18.022404 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:18.022980 10113 external_mini_cluster.cc:1428] Setting key 3b13e0b840ea3e24b02b59511d129a21
I20260619 04:44:18.027313 29461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c: Bootstrap starting.
I20260619 04:44:18.031330 29461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:18.032411 29461 log.cc:824] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:18.035569 29461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c: No bootstrap required, opened a new log
Jun 19 04:44:18 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:18.043888 29461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944683358d5e435489bc326343f1113c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43919 } }
I20260619 04:44:18.044304 29461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:18.044421 29461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944683358d5e435489bc326343f1113c, State: Initialized, Role: FOLLOWER
I20260619 04:44:18.045151 29461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944683358d5e435489bc326343f1113c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43919 } }
I20260619 04:44:18.045544 29461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:18.045699 29461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:18.045892 29461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:18.048905 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:18.024974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.9.224.126:43919)
0619 04:44:18.025818 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:18.025829 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:18.025872 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:44:18.027739 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:18.027763 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:18.028208 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:18.028561 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:18.030782 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:18.032424 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:18.034427 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:18.035210 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:18.035423 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:18.040052 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:18.040064 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:18.040079 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:18.040120 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:18.043784 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:18.044643 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:18.044652 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:18.044661 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:18.044908 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:18.045288 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:18.045293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:18.045297 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:18.046163 (+ 866us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:18.046532 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:18.046944 (+ 412us) server_negotiation.cc:299] Negotiation successful
0619 04:44:18.047438 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":402,"threads_started":1}
I20260619 04:44:18.049472 29461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944683358d5e435489bc326343f1113c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43919 } }
I20260619 04:44:18.050096 29461 leader_election.cc:302] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 944683358d5e435489bc326343f1113c; no voters:
I20260619 04:44:18.050851 29461 leader_election.cc:288] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:18.051051 29466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:18.052263 29466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [term 1 LEADER]: Becoming Leader. State: Replica: 944683358d5e435489bc326343f1113c, State: Running, Role: LEADER
I20260619 04:44:18.052842 29466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944683358d5e435489bc326343f1113c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43919 } }
I20260619 04:44:18.053233 29461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:18.055207 29468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 944683358d5e435489bc326343f1113c. Latest consensus state: current_term: 1 leader_uuid: "944683358d5e435489bc326343f1113c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944683358d5e435489bc326343f1113c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43919 } } }
I20260619 04:44:18.055547 29468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:18.056130 29467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "944683358d5e435489bc326343f1113c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944683358d5e435489bc326343f1113c" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 43919 } } }
I20260619 04:44:18.056427 29467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:18.056452 29472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:18.063483 29472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:18.073110 29472 catalog_manager.cc:1347] Generated new cluster ID: 5e5cea6972e64e649088e3071b0ea7da
I20260619 04:44:18.073239 29472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:18.103098 29472 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:18.104985 29472 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:18.116889 29472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c: Generated new TSK 0
I20260619 04:44:18.117782 29472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.224.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
Entry for principal kudu/127.9.224.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab.
I20260619 04:44:18.185221 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:43919
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:42065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:18.524951 29487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:18.525260 29487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:18.525424 29487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:18.532913 29487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:18.533046 29487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:18.533245 29487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:44:18.543632 29487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.65.keytab
--principal=kudu/127.9.224.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:43919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:18.544968 29487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:18.546375 29487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:18.560352 29492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:18.560278 29493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:18.560314 29495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:18.561605 29487 server_base.cc:1034] running on GCE node
I20260619 04:44:18.562294 29487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:18.563345 29487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:18.564553 29487 hybrid_clock.cc:648] HybridClock initialized: now 1781844258564500 us; error 42 us; skew 500 ppm
I20260619 04:44:18.564859 29487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:18 dist-test-slave-9dgf krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844258, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:18.568266 29487 init.cc:377] Logged in from keytab as kudu/127.9.224.65@KRBTEST.COM (short username kudu)
I20260619 04:44:18.569870 29487 webserver.cc:460] Webserver started at http://127.9.224.65:38669/ using document root <none> and password file <none>
I20260619 04:44:18.570638 29487 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:18.570744 29487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:18.571026 29487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:18.574013 29487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "6ea6a276e86e4eacbde99b0688e7d6c3"
format_stamp: "Formatted at 2026-06-19 04:44:18 on dist-test-slave-9dgf"
server_key: "b619015f5c56c9e8670987484ee284b2"
server_key_iv: "74573b40d2e01f5c892ab4fca6dc58b1"
server_key_version: "encryptionkey@0"
I20260619 04:44:18.574923 29487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "6ea6a276e86e4eacbde99b0688e7d6c3"
format_stamp: "Formatted at 2026-06-19 04:44:18 on dist-test-slave-9dgf"
server_key: "b619015f5c56c9e8670987484ee284b2"
server_key_iv: "74573b40d2e01f5c892ab4fca6dc58b1"
server_key_version: "encryptionkey@0"
I20260619 04:44:18.580295 29487 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:18.583879 29502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:18.585268 29487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:44:18.585439 29487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "6ea6a276e86e4eacbde99b0688e7d6c3"
format_stamp: "Formatted at 2026-06-19 04:44:18 on dist-test-slave-9dgf"
server_key: "b619015f5c56c9e8670987484ee284b2"
server_key_iv: "74573b40d2e01f5c892ab4fca6dc58b1"
server_key_version: "encryptionkey@0"
I20260619 04:44:18.585647 29487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:18.602710 29487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:18.607591 29487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:18.607896 29487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:18.608939 29487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:18.610383 29487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:18.610477 29487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:18.610617 29487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:18.610684 29487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:18.644219 29487 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:39785
I20260619 04:44:18.644280 29614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:39785 every 8 connection(s)
I20260619 04:44:18.645596 29487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:44:18.654331 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29487
I20260619 04:44:18.654523 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:44:18.654963 10113 external_mini_cluster.cc:1428] Setting key 9c332b75767ce3c24d23ad6264c8ae98
Jun 19 04:44:18 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844258, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.65@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:18.668329 29617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:18.648668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:45919 (local address 127.9.224.126:43919)
0619 04:44:18.649193 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:18.649198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:18.650140 (+ 942us) server_negotiation.cc:407] Connection header received
0619 04:44:18.652131 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:18.652137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:18.652240 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:18.652360 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:18.654183 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:18.655160 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:18.657382 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:18.657793 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:18.657930 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:18.661714 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:18.661726 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:18.661729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:18.661763 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:18.664563 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:18.665455 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:18.665463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:18.665467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:18.665642 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:18.666085 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:18.666093 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:18.666100 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:18.666546 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:18.666714 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:18.667491 (+ 777us) server_negotiation.cc:299] Negotiation successful
0619 04:44:18.667771 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":314,"threads_started":1}
I20260619 04:44:18.668977 29618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:18.649089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:43919 (local address 127.9.224.65:45919)
0619 04:44:18.649950 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:18.649995 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:18.651831 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:18.652653 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:18.652663 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:18.653294 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:18.653980 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:18.653999 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:18.655333 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:18.655337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:18.657242 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:18.657255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:18.658042 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:18.658049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:18.658386 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:18.659122 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:18.659147 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:18.661466 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:18.664758 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:18.664769 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:18.664789 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:18.665306 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:18.665767 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:18.665771 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:18.665773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:18.665971 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:18.666707 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:18.666715 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:18.667072 (+ 357us) client_negotiation.cc:769] Sending connection context
0619 04:44:18.667329 (+ 257us) client_negotiation.cc:240] Negotiation successful
0619 04:44:18.667761 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":315,"threads_started":1}
I20260619 04:44:18.670763 29615 heartbeater.cc:347] Connected to a master server at 127.9.224.126:43919
I20260619 04:44:18.671114 29615 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:18.672079 29615 heartbeater.cc:511] Master 127.9.224.126:43919 requested a full tablet report, sending...
I20260619 04:44:18.674757 29426 ts_manager.cc:194] Registered new tserver with Master: 6ea6a276e86e4eacbde99b0688e7d6c3 (127.9.224.65:39785)
I20260619 04:44:18.676453 29426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.65@KRBTEST.COM'} at 127.9.224.65:45919
WARNING: no policy specified for kudu/127.9.224.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
Entry for principal kudu/127.9.224.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab.
I20260619 04:44:18.717408 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:43919
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:42065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:19.068823 29621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:19.069159 29621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:19.069329 29621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:19.076807 29621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:19.076969 29621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:19.077140 29621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:44:19.087301 29621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.66.keytab
--principal=kudu/127.9.224.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:43919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:19.088662 29621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:19.090152 29621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:19.103338 29626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:19.103276 29627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:19.103371 29629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:19.104478 29621 server_base.cc:1034] running on GCE node
I20260619 04:44:19.105155 29621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:19.106151 29621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:19.107410 29621 hybrid_clock.cc:648] HybridClock initialized: now 1781844259107356 us; error 48 us; skew 500 ppm
I20260619 04:44:19.107741 29621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:19 dist-test-slave-9dgf krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844259, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:19.111066 29621 init.cc:377] Logged in from keytab as kudu/127.9.224.66@KRBTEST.COM (short username kudu)
I20260619 04:44:19.112557 29621 webserver.cc:460] Webserver started at http://127.9.224.66:33413/ using document root <none> and password file <none>
I20260619 04:44:19.113198 29621 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:19.113306 29621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:19.113546 29621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:19.116417 29621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "d3a37559f37148f0ba1f65ae36c2c8c4"
format_stamp: "Formatted at 2026-06-19 04:44:19 on dist-test-slave-9dgf"
server_key: "98d4c6919f20fc40ac6c8f38ffa77e4e"
server_key_iv: "16f0bccbaa4198471cce886d17474a29"
server_key_version: "encryptionkey@0"
I20260619 04:44:19.117123 29621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "d3a37559f37148f0ba1f65ae36c2c8c4"
format_stamp: "Formatted at 2026-06-19 04:44:19 on dist-test-slave-9dgf"
server_key: "98d4c6919f20fc40ac6c8f38ffa77e4e"
server_key_iv: "16f0bccbaa4198471cce886d17474a29"
server_key_version: "encryptionkey@0"
I20260619 04:44:19.122427 29621 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 04:44:19.126152 29636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:19.127630 29621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:19.127811 29621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "d3a37559f37148f0ba1f65ae36c2c8c4"
format_stamp: "Formatted at 2026-06-19 04:44:19 on dist-test-slave-9dgf"
server_key: "98d4c6919f20fc40ac6c8f38ffa77e4e"
server_key_iv: "16f0bccbaa4198471cce886d17474a29"
server_key_version: "encryptionkey@0"
I20260619 04:44:19.128037 29621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:19.153698 29621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:19.158282 29621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:19.158586 29621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:19.159634 29621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:19.161064 29621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:19.161137 29621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:19.161300 29621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:19.161350 29621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:19.195688 29621 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:38557
I20260619 04:44:19.195777 29748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:38557 every 8 connection(s)
I20260619 04:44:19.196990 29621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:44:19.203336 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29621
I20260619 04:44:19.203526 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:44:19.203950 10113 external_mini_cluster.cc:1428] Setting key b2feecbbb50ad66a8646a512d58d5464
Jun 19 04:44:19 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844259, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.66@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:19.218683 29751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.199614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:46959 (local address 127.9.224.126:43919)
0619 04:44:19.200089 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.200093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.200877 (+ 784us) server_negotiation.cc:407] Connection header received
0619 04:44:19.202826 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.202832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.202920 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.203053 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:19.204637 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.205574 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.207221 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.207659 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.207794 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.211830 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:19.211835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:19.211838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:19.211870 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:19.215261 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:19.215974 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:19.215982 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:19.215988 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:19.216145 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:19.216601 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:19.216608 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:19.216614 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:19.216992 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:19.217139 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.217898 (+ 759us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.218147 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":279,"threads_started":1}
I20260619 04:44:19.219437 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.200049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:43919 (local address 127.9.224.66:46959)
0619 04:44:19.200728 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.200764 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.202554 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.203272 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.203280 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.203875 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:19.204471 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.204489 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.205758 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.205761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.207077 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.207089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.207893 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.207900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.208124 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.208846 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:19.208868 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:19.211588 (+ 2720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:19.215400 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:19.215407 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:19.215421 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:19.215843 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:19.216277 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:19.216281 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:19.216284 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:19.216481 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:19.217126 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:19.217132 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:19.217491 (+ 359us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.217733 (+ 242us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.218143 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":265,"threads_started":1}
I20260619 04:44:19.220954 29749 heartbeater.cc:347] Connected to a master server at 127.9.224.126:43919
I20260619 04:44:19.221287 29749 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:19.221997 29749 heartbeater.cc:511] Master 127.9.224.126:43919 requested a full tablet report, sending...
I20260619 04:44:19.223625 29426 ts_manager.cc:194] Registered new tserver with Master: d3a37559f37148f0ba1f65ae36c2c8c4 (127.9.224.66:38557)
I20260619 04:44:19.224465 29426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.66@KRBTEST.COM'} at 127.9.224.66:46959
WARNING: no policy specified for kudu/127.9.224.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
Entry for principal kudu/127.9.224.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab.
I20260619 04:44:19.263242 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:43919
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:42065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:19.593053 29755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:19.593395 29755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:19.593561 29755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:19.601122 29755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:19.601281 29755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:19.601454 29755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:44:19.611878 29755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.67.keytab
--principal=kudu/127.9.224.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:43919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:19.613241 29755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:19.614665 29755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:19.628207 29760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:19.628159 29761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:19.628283 29763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:19.628706 29755 server_base.cc:1034] running on GCE node
I20260619 04:44:19.629581 29755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:19.630612 29755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:19.631832 29755 hybrid_clock.cc:648] HybridClock initialized: now 1781844259631784 us; error 42 us; skew 500 ppm
I20260619 04:44:19.632211 29755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:19 dist-test-slave-9dgf krb5kdc[29381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844259, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:19.635453 29755 init.cc:377] Logged in from keytab as kudu/127.9.224.67@KRBTEST.COM (short username kudu)
I20260619 04:44:19.636961 29755 webserver.cc:460] Webserver started at http://127.9.224.67:44609/ using document root <none> and password file <none>
I20260619 04:44:19.637616 29755 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:19.637712 29755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:19.637972 29755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:19.640970 29755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "edf4be55f3724ad39e3a26ed423b1c21"
format_stamp: "Formatted at 2026-06-19 04:44:19 on dist-test-slave-9dgf"
server_key: "38e7a5ccb13775f34224ebff5c3f0e59"
server_key_iv: "d4336989597d22a27f94fb9bb87cd35c"
server_key_version: "encryptionkey@0"
I20260619 04:44:19.641757 29755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "edf4be55f3724ad39e3a26ed423b1c21"
format_stamp: "Formatted at 2026-06-19 04:44:19 on dist-test-slave-9dgf"
server_key: "38e7a5ccb13775f34224ebff5c3f0e59"
server_key_iv: "d4336989597d22a27f94fb9bb87cd35c"
server_key_version: "encryptionkey@0"
I20260619 04:44:19.647296 29755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260619 04:44:19.650995 29770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:19.652355 29755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:19.652508 29755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "edf4be55f3724ad39e3a26ed423b1c21"
format_stamp: "Formatted at 2026-06-19 04:44:19 on dist-test-slave-9dgf"
server_key: "38e7a5ccb13775f34224ebff5c3f0e59"
server_key_iv: "d4336989597d22a27f94fb9bb87cd35c"
server_key_version: "encryptionkey@0"
I20260619 04:44:19.652693 29755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:19.679836 29755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:19.680866 29615 heartbeater.cc:503] Master 127.9.224.126:43919 was elected leader, sending a full tablet report...
I20260619 04:44:19.684696 29755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:19.685011 29755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:19.685997 29755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:19.687384 29755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:19.687484 29755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:19.687619 29755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:19.687695 29755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:19.719026 29755 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:39491
I20260619 04:44:19.719055 29882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:39491 every 8 connection(s)
I20260619 04:44:19.720367 29755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:44:19.728673 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29755
I20260619 04:44:19.728868 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:44:19.729306 10113 external_mini_cluster.cc:1428] Setting key 12cd8fe69b1d5fd9680ec1d576152473
Jun 19 04:44:19 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844259, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.67@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:19.741629 29885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.723009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:42053 (local address 127.9.224.126:43919)
0619 04:44:19.723447 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.723452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.724454 (+ 1002us) server_negotiation.cc:407] Connection header received
0619 04:44:19.726368 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.726373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.726444 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.726548 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:19.728448 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.729379 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.731391 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.731899 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.732024 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.735567 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:19.735573 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:19.735576 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:19.735614 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:19.738524 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:19.739322 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:19.739327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:19.739329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:19.739457 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:19.739944 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:19.739948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:19.739951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:19.740277 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:19.740413 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.741160 (+ 747us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.741361 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":221,"threads_started":1}
I20260619 04:44:19.742691 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.723580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:43919 (local address 127.9.224.67:42053)
0619 04:44:19.724281 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.724325 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.725985 (+ 1660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.726810 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.726818 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.727493 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:19.728114 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.728133 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.729535 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.729540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.731235 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.731250 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.732116 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.732124 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.732423 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.733103 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:44:19.733127 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:19.735340 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:19.738683 (+ 3343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:19.738691 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:19.738706 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:19.739176 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:19.739583 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:44:19.739587 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:44:19.739589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:44:19.739812 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:44:19.740412 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:19.740418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:19.740789 (+ 371us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.741036 (+ 247us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.741444 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":256,"threads_started":1}
I20260619 04:44:19.744184 29883 heartbeater.cc:347] Connected to a master server at 127.9.224.126:43919
I20260619 04:44:19.744529 29883 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:19.745378 29883 heartbeater.cc:511] Master 127.9.224.126:43919 requested a full tablet report, sending...
I20260619 04:44:19.746963 29426 ts_manager.cc:194] Registered new tserver with Master: edf4be55f3724ad39e3a26ed423b1c21 (127.9.224.67:39491)
I20260619 04:44:19.747776 29426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.224.67@KRBTEST.COM'} at 127.9.224.67:42053
I20260619 04:44:19.757628 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:44:19.775039 29885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.762008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.9.224.126:43919)
0619 04:44:19.762208 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.762214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.762591 (+ 377us) server_negotiation.cc:407] Connection header received
0619 04:44:19.762805 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.762809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.762890 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.762982 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:19.764378 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.765176 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.766610 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.767005 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.767101 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.769527 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:19.769531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:19.769535 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:19.769568 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:19.772224 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:19.772886 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:19.772891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:19.772893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:19.773026 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:19.773404 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:19.773407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:19.773409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:19.773808 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:19.773997 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.774416 (+ 419us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.774712 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:44:19.778942 29426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:44:19.785801 29426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:44:19.811137 29897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.797726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46692 (local address 127.9.224.67:39491)
0619 04:44:19.798948 (+ 1222us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.798958 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.799666 (+ 708us) server_negotiation.cc:407] Connection header received
0619 04:44:19.799786 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.799794 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.800100 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.800331 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:19.801566 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.803831 (+ 2265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.807712 (+ 3881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.809556 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.809683 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.809943 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.810612 (+ 669us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.810795 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1033,"thread_start_us":833,"threads_started":1}
I20260619 04:44:19.811216 29896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.797501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:39491 (local address 127.0.0.1:46692)
0619 04:44:19.799273 (+ 1772us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.799309 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.799483 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.800708 (+ 1225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.800720 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.800777 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:19.801269 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.801285 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.804052 (+ 2767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.804061 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.807425 (+ 3364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.807451 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.810078 (+ 2627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.810087 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.810334 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.810410 (+ 76us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.810568 (+ 158us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.810810 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1552,"thread_start_us":1497,"threads_started":1}
I20260619 04:44:19.815596 29818 tablet_service.cc:1467] Processing CreateTablet for tablet 06352b53f467438c8f35e901310968d0 (DEFAULT_TABLE table=test-table [id=f6c9a3a3407145de81da117b87f00bec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:19.817276 29818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06352b53f467438c8f35e901310968d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:19.817538 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.800101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49526 (local address 127.9.224.66:38557)
0619 04:44:19.810057 (+ 9956us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.810067 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.810094 (+ 27us) server_negotiation.cc:407] Connection header received
0619 04:44:19.810195 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.810202 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.810478 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.811460 (+ 982us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:19.811705 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.813160 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.815415 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.816453 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.816602 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.816813 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.817025 (+ 212us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.817207 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9779,"thread_start_us":9884,"threads_started":1}
I20260619 04:44:19.818022 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.799807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:38557 (local address 127.0.0.1:49526)
0619 04:44:19.809418 (+ 9611us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.809436 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.809544 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.810698 (+ 1154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.810704 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.810732 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:19.811166 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.811186 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.813299 (+ 2113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.813305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.815266 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.815277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.816650 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.816656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.816828 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.816869 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.816980 (+ 111us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.817113 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9491,"mutex_wait_us":6,"thread_start_us":9407,"threads_started":1}
I20260619 04:44:19.818380 29898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.798300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:39785 (local address 127.0.0.1:33930)
0619 04:44:19.809030 (+ 10730us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.809052 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.809457 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.810367 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.810371 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.810397 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:19.810943 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.810963 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.813001 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.813008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.815286 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.815301 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.817463 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.817469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.817648 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.817679 (+ 31us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.817766 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.817894 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10573,"mutex_wait_us":25,"thread_start_us":10405,"threads_started":1}
I20260619 04:44:19.818449 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.798793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33930 (local address 127.9.224.65:39785)
0619 04:44:19.799464 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.799476 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.809176 (+ 9700us) server_negotiation.cc:407] Connection header received
0619 04:44:19.809702 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.809713 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.810026 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.810285 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:19.811176 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.812852 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.815475 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.816953 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.817092 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.817334 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.817856 (+ 522us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.818051 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":309,"threads_started":1}
I20260619 04:44:19.822484 29550 tablet_service.cc:1467] Processing CreateTablet for tablet 06352b53f467438c8f35e901310968d0 (DEFAULT_TABLE table=test-table [id=f6c9a3a3407145de81da117b87f00bec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:19.824098 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06352b53f467438c8f35e901310968d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:19.824535 29684 tablet_service.cc:1467] Processing CreateTablet for tablet 06352b53f467438c8f35e901310968d0 (DEFAULT_TABLE table=test-table [id=f6c9a3a3407145de81da117b87f00bec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:19.825596 29684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06352b53f467438c8f35e901310968d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:19.832670 29902 tablet_bootstrap.cc:492] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Bootstrap starting.
I20260619 04:44:19.836485 29902 tablet_bootstrap.cc:654] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:19.838011 29903 tablet_bootstrap.cc:492] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Bootstrap starting.
I20260619 04:44:19.838632 29902 log.cc:824] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:19.839592 29904 tablet_bootstrap.cc:492] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Bootstrap starting.
I20260619 04:44:19.841820 29903 tablet_bootstrap.cc:654] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:19.842536 29902 tablet_bootstrap.cc:492] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: No bootstrap required, opened a new log
I20260619 04:44:19.842804 29902 ts_tablet_manager.cc:1397] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260619 04:44:19.843086 29904 tablet_bootstrap.cc:654] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:19.843144 29903 log.cc:824] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:19.844267 29904 log.cc:824] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:19.846351 29903 tablet_bootstrap.cc:492] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: No bootstrap required, opened a new log
I20260619 04:44:19.846657 29903 ts_tablet_manager.cc:1397] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260619 04:44:19.847368 29904 tablet_bootstrap.cc:492] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: No bootstrap required, opened a new log
I20260619 04:44:19.847604 29904 ts_tablet_manager.cc:1397] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260619 04:44:19.851867 29902 raft_consensus.cc:348] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.852312 29902 raft_consensus.cc:374] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:19.852523 29902 raft_consensus.cc:729] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf4be55f3724ad39e3a26ed423b1c21, State: Initialized, Role: FOLLOWER
I20260619 04:44:19.853333 29902 consensus_queue.cc:260] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.854660 29883 heartbeater.cc:503] Master 127.9.224.126:43919 was elected leader, sending a full tablet report...
I20260619 04:44:19.855122 29902 ts_tablet_manager.cc:1428] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Time spent starting tablet: real 0.012s user 0.006s sys 0.005s
I20260619 04:44:19.857496 29903 raft_consensus.cc:348] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.857935 29903 raft_consensus.cc:374] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:19.858037 29903 raft_consensus.cc:729] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea6a276e86e4eacbde99b0688e7d6c3, State: Initialized, Role: FOLLOWER
I20260619 04:44:19.858732 29903 consensus_queue.cc:260] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.860616 29903 ts_tablet_manager.cc:1428] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260619 04:44:19.862102 29904 raft_consensus.cc:348] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.862669 29904 raft_consensus.cc:374] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:19.862802 29904 raft_consensus.cc:729] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a37559f37148f0ba1f65ae36c2c8c4, State: Initialized, Role: FOLLOWER
I20260619 04:44:19.863418 29904 consensus_queue.cc:260] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.864899 29749 heartbeater.cc:503] Master 127.9.224.126:43919 was elected leader, sending a full tablet report...
I20260619 04:44:19.865561 29904 ts_tablet_manager.cc:1428] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Time spent starting tablet: real 0.018s user 0.015s sys 0.000s
W20260619 04:44:19.898365 29616 tablet.cc:2369] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:19.949079 29750 tablet.cc:2369] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 04:44:19.972088 29884 tablet.cc:2369] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:19.986441 29909 raft_consensus.cc:482] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:19.986776 29909 raft_consensus.cc:504] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:19.988767 29909 leader_election.cc:288] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf4be55f3724ad39e3a26ed423b1c21 (127.9.224.67:39491), d3a37559f37148f0ba1f65ae36c2c8c4 (127.9.224.66:38557)
I20260619 04:44:19.996796 29897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.989263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:41355 (local address 127.9.224.67:39491)
0619 04:44:19.989536 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.989543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.989726 (+ 183us) server_negotiation.cc:407] Connection header received
0619 04:44:19.989976 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.989986 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.990092 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.990223 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:19.990935 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.991943 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.994453 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.995809 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.996008 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.996102 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.996402 (+ 300us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.996530 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260619 04:44:19.996954 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.988951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:39491 (local address 127.9.224.65:41355)
0619 04:44:19.989620 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.989636 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.989797 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.990358 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.990362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.990403 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:19.990805 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.990819 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.992058 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.992062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.994280 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.994296 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.996039 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.996045 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.996184 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.996210 (+ 26us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.996372 (+ 162us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.996524 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":5,"thread_start_us":471,"threads_started":1}
I20260619 04:44:19.997198 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.989973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:57619 (local address 127.9.224.66:38557)
0619 04:44:19.990191 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:19.990199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:19.990723 (+ 524us) server_negotiation.cc:407] Connection header received
0619 04:44:19.990884 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:19.990890 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:19.990975 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:19.991075 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:19.991537 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.992416 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.994838 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.996177 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.996304 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.996405 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:19.996757 (+ 352us) server_negotiation.cc:299] Negotiation successful
0619 04:44:19.996915 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:44:19.997759 29912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:19.989810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:38557 (local address 127.9.224.65:57619)
0619 04:44:19.990577 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:19.990599 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:19.990736 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:19.991092 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:19.991095 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:19.991114 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:19.991401 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.991408 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.992550 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.992556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.994678 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:19.994689 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:19.996401 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:19.996407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:19.996580 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:19.996610 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 04:44:19.996711 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 04:44:19.997439 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":33,"thread_start_us":424,"threads_started":1}
I20260619 04:44:19.998183 29838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06352b53f467438c8f35e901310968d0" candidate_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf4be55f3724ad39e3a26ed423b1c21" is_pre_election: true
I20260619 04:44:19.998821 29838 raft_consensus.cc:2454] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ea6a276e86e4eacbde99b0688e7d6c3 in term 0.
I20260619 04:44:19.998857 29704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06352b53f467438c8f35e901310968d0" candidate_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" is_pre_election: true
I20260619 04:44:19.999373 29704 raft_consensus.cc:2454] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ea6a276e86e4eacbde99b0688e7d6c3 in term 0.
I20260619 04:44:19.999627 29503 leader_election.cc:302] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea6a276e86e4eacbde99b0688e7d6c3, edf4be55f3724ad39e3a26ed423b1c21; no voters:
I20260619 04:44:20.000043 29909 raft_consensus.cc:2781] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:44:20.000206 29909 raft_consensus.cc:482] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:44:20.000329 29909 raft_consensus.cc:3037] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:20.002596 29909 raft_consensus.cc:504] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:20.003228 29909 leader_election.cc:288] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [CANDIDATE]: Term 1 election: Requested vote from peers edf4be55f3724ad39e3a26ed423b1c21 (127.9.224.67:39491), d3a37559f37148f0ba1f65ae36c2c8c4 (127.9.224.66:38557)
I20260619 04:44:20.003690 29838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06352b53f467438c8f35e901310968d0" candidate_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf4be55f3724ad39e3a26ed423b1c21"
I20260619 04:44:20.003727 29704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06352b53f467438c8f35e901310968d0" candidate_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4"
I20260619 04:44:20.003899 29838 raft_consensus.cc:3037] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:20.003924 29704 raft_consensus.cc:3037] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:20.006120 29838 raft_consensus.cc:2454] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea6a276e86e4eacbde99b0688e7d6c3 in term 1.
I20260619 04:44:20.006151 29704 raft_consensus.cc:2454] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea6a276e86e4eacbde99b0688e7d6c3 in term 1.
I20260619 04:44:20.006613 29503 leader_election.cc:302] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea6a276e86e4eacbde99b0688e7d6c3, edf4be55f3724ad39e3a26ed423b1c21; no voters:
I20260619 04:44:20.006934 29909 raft_consensus.cc:2781] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:20.007429 29909 raft_consensus.cc:686] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 1 LEADER]: Becoming Leader. State: Replica: 6ea6a276e86e4eacbde99b0688e7d6c3, State: Running, Role: LEADER
I20260619 04:44:20.008087 29909 consensus_queue.cc:237] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } }
I20260619 04:44:20.013682 29425 catalog_manager.cc:5495] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ea6a276e86e4eacbde99b0688e7d6c3 (127.9.224.65). New cstate: current_term: 1 leader_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ea6a276e86e4eacbde99b0688e7d6c3" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 39785 } health_report { overall_health: HEALTHY } } }
I20260619 04:44:20.047432 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:20.041730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33932 (local address 127.9.224.65:39785)
0619 04:44:20.041975 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:20.041979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:20.041997 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:44:20.042214 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:20.042218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:20.042388 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:20.042518 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:44:20.042944 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.043710 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.045184 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.045594 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.045697 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:20.046199 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:44:20.046821 (+ 622us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:44:20.046937 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:20.047046 (+ 109us) server_negotiation.cc:299] Negotiation successful
0619 04:44:20.047120 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:44:20.055958 29704 raft_consensus.cc:1261] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 1 FOLLOWER]: Refusing update from remote peer 6ea6a276e86e4eacbde99b0688e7d6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:20.056078 29838 raft_consensus.cc:1261] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 1 FOLLOWER]: Refusing update from remote peer 6ea6a276e86e4eacbde99b0688e7d6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:20.056967 29913 consensus_queue.cc:1035] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3a37559f37148f0ba1f65ae36c2c8c4" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:20.057358 29909 consensus_queue.cc:1035] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf4be55f3724ad39e3a26ed423b1c21" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:20.084125 29426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:20.084408 29426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:20.088019 29426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 944683358d5e435489bc326343f1113c: Sending DeleteTablet for 3 replicas of tablet 06352b53f467438c8f35e901310968d0
I20260619 04:44:20.089201 29550 tablet_service.cc:1514] Processing DeleteTablet for tablet 06352b53f467438c8f35e901310968d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:20 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:33930
I20260619 04:44:20.089171 29818 tablet_service.cc:1514] Processing DeleteTablet for tablet 06352b53f467438c8f35e901310968d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:20 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:46692
I20260619 04:44:20.089196 29684 tablet_service.cc:1514] Processing DeleteTablet for tablet 06352b53f467438c8f35e901310968d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:20 UTC) from {username='kudu', principal='kudu/127.9.224.126@KRBTEST.COM'} at 127.0.0.1:49526
I20260619 04:44:20.092988 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29487
I20260619 04:44:20.102654 29927 tablet_replica.cc:330] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: stopping tablet replica
I20260619 04:44:20.103255 29927 raft_consensus.cc:2229] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:44:20.104029 29927 raft_consensus.cc:2258] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:20.104907 29926 tablet_replica.cc:330] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: stopping tablet replica
I20260619 04:44:20.105401 29926 raft_consensus.cc:2229] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:20.106038 29926 raft_consensus.cc:2258] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:20.109031 29927 ts_tablet_manager.cc:1905] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:20.112635 29926 ts_tablet_manager.cc:1905] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:20.113994 29928 tablet_replica.cc:330] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: stopping tablet replica
I20260619 04:44:20.114526 29928 raft_consensus.cc:2229] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 1 FOLLOWER]: Raft consensus shutting down.
Jun 19 04:44:20 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.65@KRBTEST.COM
I20260619 04:44:20.117553 29928 raft_consensus.cc:2258] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:20.119529 29926 ts_tablet_manager.cc:1918] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:20.119688 29926 log.cc:1196] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/06352b53f467438c8f35e901310968d0
I20260619 04:44:20.120224 29926 ts_tablet_manager.cc:1939] T 06352b53f467438c8f35e901310968d0 P edf4be55f3724ad39e3a26ed423b1c21: Deleting consensus metadata
I20260619 04:44:20.120422 29927 ts_tablet_manager.cc:1918] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:20.120599 29927 log.cc:1196] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/06352b53f467438c8f35e901310968d0
I20260619 04:44:20.121042 29928 ts_tablet_manager.cc:1905] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:20.121133 29927 ts_tablet_manager.cc:1939] T 06352b53f467438c8f35e901310968d0 P 6ea6a276e86e4eacbde99b0688e7d6c3: Deleting consensus metadata
I20260619 04:44:20.122277 29410 catalog_manager.cc:4841] TS edf4be55f3724ad39e3a26ed423b1c21 (127.9.224.67:39491): tablet 06352b53f467438c8f35e901310968d0 (table test-table [id=f6c9a3a3407145de81da117b87f00bec]) successfully deleted
I20260619 04:44:20.122789 29412 catalog_manager.cc:4841] TS 6ea6a276e86e4eacbde99b0688e7d6c3 (127.9.224.65:39785): tablet 06352b53f467438c8f35e901310968d0 (table test-table [id=f6c9a3a3407145de81da117b87f00bec]) successfully deleted
I20260619 04:44:20.127586 29928 ts_tablet_manager.cc:1918] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:20.127751 29928 log.cc:1196] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/06352b53f467438c8f35e901310968d0
I20260619 04:44:20.128324 29928 ts_tablet_manager.cc:1939] T 06352b53f467438c8f35e901310968d0 P d3a37559f37148f0ba1f65ae36c2c8c4: Deleting consensus metadata
I20260619 04:44:20.130272 29410 catalog_manager.cc:4841] TS d3a37559f37148f0ba1f65ae36c2c8c4 (127.9.224.66:38557): tablet 06352b53f467438c8f35e901310968d0 (table test-table [id=f6c9a3a3407145de81da117b87f00bec]) successfully deleted
I20260619 04:44:20.131938 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:20.094577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33946 (local address 127.9.224.65:39785)
0619 04:44:20.094795 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:20.094805 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:20.105178 (+ 10373us) server_negotiation.cc:407] Connection header received
0619 04:44:20.105481 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:20.105486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:20.105573 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:20.105647 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:20.107565 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.108727 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.110690 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.111452 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.111557 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:20.122531 (+ 10974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:20.122548 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:20.122566 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:20.122623 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:20.126728 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:20.128149 (+ 1421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:20.128162 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:20.128169 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:20.128630 (+ 461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:20.129382 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:20.129387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:20.129390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:20.130148 (+ 758us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:20.130738 (+ 590us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:20.131308 (+ 570us) server_negotiation.cc:299] Negotiation successful
0619 04:44:20.131559 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:44:20.133133 29610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:20.244984 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29487
I20260619 04:44:20.264274 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29621
Jun 19 04:44:20 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.66@KRBTEST.COM
I20260619 04:44:20.279414 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:20.265054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49528 (local address 127.9.224.66:38557)
0619 04:44:20.265222 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:20.265226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:20.265247 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:44:20.265406 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:20.265410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:20.265481 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:20.265585 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:20.266917 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.267679 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.268913 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.269321 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.269426 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:20.273799 (+ 4373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:20.273816 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:20.273833 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:20.273867 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:20.276895 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:20.277554 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:20.277562 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:20.277565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:20.277684 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:20.278037 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:20.278041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:20.278043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:20.278507 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:20.278764 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:20.278967 (+ 203us) server_negotiation.cc:299] Negotiation successful
0619 04:44:20.279134 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 04:44:20.280129 29744 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:20.370543 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29621
I20260619 04:44:20.388008 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29755
Jun 19 04:44:20 dist-test-slave-9dgf krb5kdc[29381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.67@KRBTEST.COM
I20260619 04:44:20.403954 29897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:20.388828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46694 (local address 127.9.224.67:39491)
0619 04:44:20.389040 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:20.389044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:20.389070 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:44:20.389188 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:20.389192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:20.389268 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:20.389368 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:20.390791 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.391597 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.393029 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:20.393463 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:20.393568 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:20.398024 (+ 4456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:20.398042 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:20.398059 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:20.398095 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:20.400981 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:20.401762 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:20.401770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:20.401772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:20.401933 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:20.402485 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:20.402489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:20.402491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:20.402927 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:20.403181 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:20.403496 (+ 315us) server_negotiation.cc:299] Negotiation successful
0619 04:44:20.403668 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260619 04:44:20.404619 29878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:20.494614 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29755
I20260619 04:44:20.511541 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29394
I20260619 04:44:20.512778 29456 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:20.625423 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29394
2026-06-19T04:44:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4510 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-06-19T04:44:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:20Z Disabled control of system clock
I20260619 04:44:20.705466 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36575
--webserver_interface=127.9.224.126
--webserver_port=0
--builtin_ntp_servers=127.9.224.84:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:36575
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 04:44:21.053103 29937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:21.053408 29937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:21.053490 29937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:21.060756 29937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:21.060863 29937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:21.060909 29937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:21.060966 29937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:21.061012 29937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:21.070215 29937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:36575
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:36575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:21.071493 29937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:21.073248 29937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:21.085016 29942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:21.085144 29945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:21.085114 29943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:21.085896 29937 server_base.cc:1034] running on GCE node
I20260619 04:44:21.086757 29937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:21.088220 29937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:21.089488 29937 hybrid_clock.cc:648] HybridClock initialized: now 1781844261089437 us; error 30 us; skew 500 ppm
I20260619 04:44:21.089998 29937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:21.092639 29937 webserver.cc:460] Webserver started at http://127.9.224.126:33413/ using document root <none> and password file <none>
I20260619 04:44:21.093430 29937 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:21.093567 29937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:21.093909 29937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:21.097198 29937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "56a132383d534623844cb025e44147bb"
format_stamp: "Formatted at 2026-06-19 04:44:21 on dist-test-slave-9dgf"
server_key: "8155c206d791455c19d138b23ca07030"
server_key_iv: "9bb63d362b02bf335ee01dae8c5cbc16"
server_key_version: "encryptionkey@0"
I20260619 04:44:21.098104 29937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "56a132383d534623844cb025e44147bb"
format_stamp: "Formatted at 2026-06-19 04:44:21 on dist-test-slave-9dgf"
server_key: "8155c206d791455c19d138b23ca07030"
server_key_iv: "9bb63d362b02bf335ee01dae8c5cbc16"
server_key_version: "encryptionkey@0"
I20260619 04:44:21.103705 29937 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:44:21.107291 29951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:21.108768 29937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:44:21.108960 29937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "56a132383d534623844cb025e44147bb"
format_stamp: "Formatted at 2026-06-19 04:44:21 on dist-test-slave-9dgf"
server_key: "8155c206d791455c19d138b23ca07030"
server_key_iv: "9bb63d362b02bf335ee01dae8c5cbc16"
server_key_version: "encryptionkey@0"
I20260619 04:44:21.109184 29937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:21.127133 29937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:21.128008 29937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:21.128305 29937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:21.147210 29937 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:36575
I20260619 04:44:21.147267 30002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:36575 every 8 connection(s)
I20260619 04:44:21.148592 29937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:21.151134 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 29937
I20260619 04:44:21.151321 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:21.151783 10113 external_mini_cluster.cc:1428] Setting key ab7fe82cfdbb6f7633fb1298168a5a1a
I20260619 04:44:21.152731 30003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:21.165071 30006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:21.153627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56562 (local address 127.9.224.126:36575)
0619 04:44:21.154647 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:21.154659 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:21.154755 (+ 96us) server_negotiation.cc:407] Connection header received
0619 04:44:21.156287 (+ 1532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:21.156308 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:21.156800 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:21.157199 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:21.157779 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:21.159212 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:21.160525 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:21.161209 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:21.161411 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:21.162673 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:21.162681 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:21.162695 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:21.163354 (+ 659us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:21.163434 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:21.163463 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:21.163613 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:21.163855 (+ 242us) server_negotiation.cc:299] Negotiation successful
0619 04:44:21.164150 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":341,"threads_started":1}
I20260619 04:44:21.165675 30003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb: Bootstrap starting.
I20260619 04:44:21.168849 30003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:21.170034 30003 log.cc:824] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:21.172848 30003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb: No bootstrap required, opened a new log
I20260619 04:44:21.180320 30003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a132383d534623844cb025e44147bb" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36575 } }
I20260619 04:44:21.180655 30003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:21.180740 30003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a132383d534623844cb025e44147bb, State: Initialized, Role: FOLLOWER
I20260619 04:44:21.181229 30003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a132383d534623844cb025e44147bb" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36575 } }
I20260619 04:44:21.181412 30003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:21.181504 30003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:21.181620 30003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:21.184101 30003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a132383d534623844cb025e44147bb" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36575 } }
I20260619 04:44:21.184569 30003 leader_election.cc:302] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56a132383d534623844cb025e44147bb; no voters:
I20260619 04:44:21.185098 30003 leader_election.cc:288] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:21.185230 30008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:21.185981 30008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [term 1 LEADER]: Becoming Leader. State: Replica: 56a132383d534623844cb025e44147bb, State: Running, Role: LEADER
I20260619 04:44:21.186510 30008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a132383d534623844cb025e44147bb" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36575 } }
I20260619 04:44:21.187264 30003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:21.189325 30009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56a132383d534623844cb025e44147bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a132383d534623844cb025e44147bb" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36575 } } }
I20260619 04:44:21.189646 30009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:21.190426 30010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56a132383d534623844cb025e44147bb. Latest consensus state: current_term: 1 leader_uuid: "56a132383d534623844cb025e44147bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a132383d534623844cb025e44147bb" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 36575 } } }
I20260619 04:44:21.191090 30010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:21.191468 30014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:21.196007 30014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:21.211639 30014 catalog_manager.cc:1347] Generated new cluster ID: f7af89f1fb024880bf330452c4c0e1e8
I20260619 04:44:21.211773 30014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:21.225054 30014 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:21.226929 30014 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:21.235437 30014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb: Generated new TSK 0
I20260619 04:44:21.236503 30014 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:21.247908 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.65:0
--local_ip_for_outbound_sockets=127.9.224.65
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36575
--builtin_ntp_servers=127.9.224.84:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 04:44:21.587623 30027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:21.588011 30027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:21.588161 30027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:21.595913 30027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:21.596074 30027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:21.596256 30027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.65
I20260619 04:44:21.605904 30027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.224.65
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36575
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.65
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:21.607313 30027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:21.609200 30027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:21.623907 30033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:21.624002 30032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:21.624025 30035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:21.625363 30027 server_base.cc:1034] running on GCE node
I20260619 04:44:21.626096 30027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:21.627172 30027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:21.628425 30027 hybrid_clock.cc:648] HybridClock initialized: now 1781844261628372 us; error 46 us; skew 500 ppm
I20260619 04:44:21.628767 30027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:21.631408 30027 webserver.cc:460] Webserver started at http://127.9.224.65:38505/ using document root <none> and password file <none>
I20260619 04:44:21.632138 30027 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:21.632273 30027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:21.632592 30027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:21.635638 30027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data/instance:
uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa"
format_stamp: "Formatted at 2026-06-19 04:44:21 on dist-test-slave-9dgf"
server_key: "def4d29d613cab9a35cebeb8c34d9fe1"
server_key_iv: "828058f0dbc50d5c0d4a44a184cfdf9e"
server_key_version: "encryptionkey@0"
I20260619 04:44:21.636554 30027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance:
uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa"
format_stamp: "Formatted at 2026-06-19 04:44:21 on dist-test-slave-9dgf"
server_key: "def4d29d613cab9a35cebeb8c34d9fe1"
server_key_iv: "828058f0dbc50d5c0d4a44a184cfdf9e"
server_key_version: "encryptionkey@0"
I20260619 04:44:21.641938 30027 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 04:44:21.645771 30041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:21.647392 30027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:21.647593 30027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal
uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa"
format_stamp: "Formatted at 2026-06-19 04:44:21 on dist-test-slave-9dgf"
server_key: "def4d29d613cab9a35cebeb8c34d9fe1"
server_key_iv: "828058f0dbc50d5c0d4a44a184cfdf9e"
server_key_version: "encryptionkey@0"
I20260619 04:44:21.647838 30027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:21.669780 30027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:21.670843 30027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:21.671178 30027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:21.672233 30027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:21.673803 30027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:21.673936 30027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:21.674060 30027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:21.674144 30027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:21.708882 30027 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.65:45915
I20260619 04:44:21.708979 30153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.65:45915 every 8 connection(s)
I20260619 04:44:21.710273 30027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/data/info.pb
I20260619 04:44:21.713862 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30027
I20260619 04:44:21.714074 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal/instance
I20260619 04:44:21.714643 10113 external_mini_cluster.cc:1428] Setting key f4def8b74b1681b01fe49492e967b5cb
I20260619 04:44:21.717418 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.66:0
--local_ip_for_outbound_sockets=127.9.224.66
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36575
--builtin_ntp_servers=127.9.224.84:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 04:44:21.723955 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:21.712883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:46395 (local address 127.9.224.126:36575)
0619 04:44:21.713321 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:21.713327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:21.714947 (+ 1620us) server_negotiation.cc:407] Connection header received
0619 04:44:21.717101 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:21.717107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:21.717196 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:21.717322 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:21.718562 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:21.719313 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:21.720907 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:21.721327 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:21.721472 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:21.723077 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:21.723083 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:21.723092 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:21.723112 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:21.723154 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:21.723165 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:21.723260 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:21.723495 (+ 235us) server_negotiation.cc:299] Negotiation successful
0619 04:44:21.723600 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":221,"threads_started":1}
I20260619 04:44:21.725070 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:21.713606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36575 (local address 127.9.224.65:46395)
0619 04:44:21.714751 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:21.714797 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:21.716822 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:21.717598 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:21.717610 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:21.717723 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:21.718389 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:21.718420 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:21.719478 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:21.719483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:21.720758 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:21.720771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:21.721573 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:21.721581 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:21.721831 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:21.722723 (+ 892us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:21.722726 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:21.722769 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:21.722863 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:21.723259 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:21.723274 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:21.723285 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 04:44:21.723471 (+ 186us) client_negotiation.cc:240] Negotiation successful
0619 04:44:21.723925 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":347,"threads_started":1}
I20260619 04:44:21.726794 30154 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36575
I20260619 04:44:21.727159 30154 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:21.728157 30154 heartbeater.cc:511] Master 127.9.224.126:36575 requested a full tablet report, sending...
I20260619 04:44:21.730875 29968 ts_manager.cc:194] Registered new tserver with Master: bbedcd78f43f4d6e9b11629ae2a1e4aa (127.9.224.65:45915)
I20260619 04:44:21.733141 29968 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.65:46395
W20260619 04:44:22.067127 30158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:22.067421 30158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:22.067510 30158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:22.074952 30158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:22.075062 30158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:22.075168 30158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.66
I20260619 04:44:22.084440 30158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.224.66
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36575
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.66
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:22.085827 30158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:22.087754 30158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:22.101876 30163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:22.101853 30166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:22.101851 30164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:22.102999 30158 server_base.cc:1034] running on GCE node
I20260619 04:44:22.103673 30158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:22.104930 30158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:22.106173 30158 hybrid_clock.cc:648] HybridClock initialized: now 1781844262106096 us; error 62 us; skew 500 ppm
I20260619 04:44:22.106621 30158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:22.114041 30158 webserver.cc:460] Webserver started at http://127.9.224.66:43345/ using document root <none> and password file <none>
I20260619 04:44:22.114952 30158 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:22.115101 30158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:22.115444 30158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:22.118759 30158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data/instance:
uuid: "93e1cf7674aa4bd4a41b0869f674cffd"
format_stamp: "Formatted at 2026-06-19 04:44:22 on dist-test-slave-9dgf"
server_key: "11fa82d0be9ccdfd97098f3090966e63"
server_key_iv: "f6367b0a27ca0076520946ede3e8e1bc"
server_key_version: "encryptionkey@0"
I20260619 04:44:22.119621 30158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance:
uuid: "93e1cf7674aa4bd4a41b0869f674cffd"
format_stamp: "Formatted at 2026-06-19 04:44:22 on dist-test-slave-9dgf"
server_key: "11fa82d0be9ccdfd97098f3090966e63"
server_key_iv: "f6367b0a27ca0076520946ede3e8e1bc"
server_key_version: "encryptionkey@0"
I20260619 04:44:22.125422 30158 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:44:22.129875 30172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:22.132354 30158 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260619 04:44:22.132599 30158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal
uuid: "93e1cf7674aa4bd4a41b0869f674cffd"
format_stamp: "Formatted at 2026-06-19 04:44:22 on dist-test-slave-9dgf"
server_key: "11fa82d0be9ccdfd97098f3090966e63"
server_key_iv: "f6367b0a27ca0076520946ede3e8e1bc"
server_key_version: "encryptionkey@0"
I20260619 04:44:22.132869 30158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:22.173167 30158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:22.174544 30158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:22.174944 30158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:22.176374 30158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:22.178699 30158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:22.178831 30158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:22.178967 30158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:22.179052 30158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:22.214524 30158 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.66:34481
I20260619 04:44:22.214610 30284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.66:34481 every 8 connection(s)
I20260619 04:44:22.215862 30158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/data/info.pb
I20260619 04:44:22.217748 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30158
I20260619 04:44:22.217924 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal/instance
I20260619 04:44:22.218518 10113 external_mini_cluster.cc:1428] Setting key 3bd0a8fa94b6e7d7bd23a51ababc4449
I20260619 04:44:22.221804 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.224.67:0
--local_ip_for_outbound_sockets=127.9.224.67
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36575
--builtin_ntp_servers=127.9.224.84:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 04:44:22.230307 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.219091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.66:58809 (local address 127.9.224.126:36575)
0619 04:44:22.219280 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.219285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.221177 (+ 1892us) server_negotiation.cc:407] Connection header received
0619 04:44:22.223173 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.223178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.223282 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.223401 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:22.224555 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.225292 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.227150 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.227582 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.227724 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.229368 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:22.229380 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:22.229384 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:22.229405 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:22.229442 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:22.229455 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:22.229541 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.229878 (+ 337us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.229976 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:44:22.231925 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.219860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36575 (local address 127.9.224.66:58809)
0619 04:44:22.221022 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.221067 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.222889 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.223661 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.223670 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.223778 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:22.224377 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.224398 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.225447 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.225458 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.226987 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.227002 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.227848 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.227860 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.228095 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.228885 (+ 790us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:22.228891 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:22.228961 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:22.229080 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:22.229569 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:22.229580 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:22.229589 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.229837 (+ 248us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.230378 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":343,"threads_started":1}
I20260619 04:44:22.233552 30285 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36575
I20260619 04:44:22.233927 30285 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:22.234807 30285 heartbeater.cc:511] Master 127.9.224.126:36575 requested a full tablet report, sending...
I20260619 04:44:22.236305 29968 ts_manager.cc:194] Registered new tserver with Master: 93e1cf7674aa4bd4a41b0869f674cffd (127.9.224.66:34481)
I20260619 04:44:22.237129 29968 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.66:58809
W20260619 04:44:22.562973 30288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:22.563263 30288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:22.563408 30288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:22.570835 30288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:22.570952 30288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:22.571131 30288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.224.67
I20260619 04:44:22.580330 30288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.224.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.224.67
--webserver_port=0
--tserver_master_addrs=127.9.224.126:36575
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.224.67
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:22.581808 30288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:22.583635 30288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:22.597038 30293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:22.597172 30294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:22.597138 30296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:22.598084 30288 server_base.cc:1034] running on GCE node
I20260619 04:44:22.598867 30288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:22.599987 30288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:22.601226 30288 hybrid_clock.cc:648] HybridClock initialized: now 1781844262601184 us; error 70 us; skew 500 ppm
I20260619 04:44:22.601570 30288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 04:44:22.603953 30288 webserver.cc:460] Webserver started at http://127.9.224.67:33169/ using document root <none> and password file <none>
I20260619 04:44:22.604668 30288 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:22.604800 30288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:22.605123 30288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:22.608139 30288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data/instance:
uuid: "2fcdf9015214435a8fd53e9a400e9c6e"
format_stamp: "Formatted at 2026-06-19 04:44:22 on dist-test-slave-9dgf"
server_key: "3d90e6ec3b44991f8aa818eb58c06612"
server_key_iv: "ae5bef5e2a126c8f36caa33e9986436e"
server_key_version: "encryptionkey@0"
I20260619 04:44:22.608978 30288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance:
uuid: "2fcdf9015214435a8fd53e9a400e9c6e"
format_stamp: "Formatted at 2026-06-19 04:44:22 on dist-test-slave-9dgf"
server_key: "3d90e6ec3b44991f8aa818eb58c06612"
server_key_iv: "ae5bef5e2a126c8f36caa33e9986436e"
server_key_version: "encryptionkey@0"
I20260619 04:44:22.614388 30288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 04:44:22.617950 30302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:22.619405 30288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:22.619598 30288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal
uuid: "2fcdf9015214435a8fd53e9a400e9c6e"
format_stamp: "Formatted at 2026-06-19 04:44:22 on dist-test-slave-9dgf"
server_key: "3d90e6ec3b44991f8aa818eb58c06612"
server_key_iv: "ae5bef5e2a126c8f36caa33e9986436e"
server_key_version: "encryptionkey@0"
I20260619 04:44:22.619838 30288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:22.633445 30288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:22.634402 30288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:22.634709 30288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:22.635691 30288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 04:44:22.637214 30288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 04:44:22.637336 30288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:22.637485 30288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 04:44:22.637574 30288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:22.671269 30288 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.67:46633
I20260619 04:44:22.671355 30414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.67:46633 every 8 connection(s)
I20260619 04:44:22.672618 30288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/data/info.pb
I20260619 04:44:22.680966 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30288
I20260619 04:44:22.681140 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal/instance
I20260619 04:44:22.681572 10113 external_mini_cluster.cc:1428] Setting key 17baccc6116eb335a08232c172ea4c38
I20260619 04:44:22.685735 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.675221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.67:44473 (local address 127.9.224.126:36575)
0619 04:44:22.675408 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.675412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.676895 (+ 1483us) server_negotiation.cc:407] Connection header received
0619 04:44:22.678842 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.678848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.678944 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.679053 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:22.680144 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.681154 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.683086 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.683576 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.683710 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.685083 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:22.685088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:22.685091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:22.685107 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:22.685137 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:22.685148 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:22.685218 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.685432 (+ 214us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.685507 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:44:22.686867 30417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.675790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:36575 (local address 127.9.224.67:44473)
0619 04:44:22.676708 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.676755 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.678542 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.679300 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.679309 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.679404 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:44:22.679977 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.679993 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.681332 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.681337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.682954 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.682967 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.683778 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.683783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.683995 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.684786 (+ 791us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 04:44:22.684789 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:44:22.684831 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 04:44:22.684914 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:44:22.685246 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:44:22.685255 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:44:22.685261 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.685407 (+ 146us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.685705 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":271,"threads_started":1}
I20260619 04:44:22.688462 30415 heartbeater.cc:347] Connected to a master server at 127.9.224.126:36575
I20260619 04:44:22.688828 30415 heartbeater.cc:464] Registering TS with master...
I20260619 04:44:22.689524 30415 heartbeater.cc:511] Master 127.9.224.126:36575 requested a full tablet report, sending...
I20260619 04:44:22.690956 29968 ts_manager.cc:194] Registered new tserver with Master: 2fcdf9015214435a8fd53e9a400e9c6e (127.9.224.67:46633)
I20260619 04:44:22.691720 29968 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.224.67:44473
I20260619 04:44:22.696969 10113 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 04:44:22.707062 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.701593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56572 (local address 127.9.224.126:36575)
0619 04:44:22.701830 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.701834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.702140 (+ 306us) server_negotiation.cc:407] Connection header received
0619 04:44:22.702347 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.702351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.702411 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.702496 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:22.702972 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.703655 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.704971 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.705389 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.705483 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.706497 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:22.706502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:22.706506 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:22.706521 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:22.706551 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:22.706563 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:22.706632 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.706738 (+ 106us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.706847 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260619 04:44:22.711874 29968 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 04:44:22.719182 29968 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 04:44:22.736747 30154 heartbeater.cc:503] Master 127.9.224.126:36575 was elected leader, sending a full tablet report...
I20260619 04:44:22.745471 30427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.731472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:46633 (local address 127.0.0.1:45012)
0619 04:44:22.733574 (+ 2102us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.733611 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.733806 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.734463 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.734471 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.734501 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:22.734944 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.734966 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.739430 (+ 4464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.739436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.742126 (+ 2690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.742148 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.744445 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.744451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.744692 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.744775 (+ 83us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.744910 (+ 135us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.745107 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1899,"thread_start_us":1762,"threads_started":1}
I20260619 04:44:22.746430 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.732317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45012 (local address 127.9.224.67:46633)
0619 04:44:22.733258 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.733278 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.733716 (+ 438us) server_negotiation.cc:407] Connection header received
0619 04:44:22.734006 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.734014 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.734217 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.734457 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:22.735190 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.739247 (+ 4057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.742410 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.743877 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.744005 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.744294 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.745877 (+ 1583us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.746056 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":583,"threads_started":1}
I20260619 04:44:22.751130 30350 tablet_service.cc:1467] Processing CreateTablet for tablet 9792c77db78b4d178c0d1c206fcd383f (DEFAULT_TABLE table=test-table [id=74b2ebf2a02148a89417a750d8018c8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:22.753114 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9792c77db78b4d178c0d1c206fcd383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:22.753175 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.731649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:34481 (local address 127.0.0.1:55610)
0619 04:44:22.744582 (+ 12933us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.744609 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.744776 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.745782 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.745788 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.745813 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:22.746107 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.746116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.747933 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.747939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.750020 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.750036 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.752382 (+ 2346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.752393 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.752558 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.752593 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.752689 (+ 96us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.752832 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12753,"thread_start_us":12605,"threads_started":1}
I20260619 04:44:22.753948 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.732262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.9.224.66:34481)
0619 04:44:22.743196 (+ 10934us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.743210 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.744932 (+ 1722us) server_negotiation.cc:407] Connection header received
0619 04:44:22.745055 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.745067 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.745371 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.745575 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:22.746294 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.747763 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.750266 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.751754 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.751892 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.752142 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.753404 (+ 1262us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.753594 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10734,"thread_start_us":10612,"threads_started":1}
I20260619 04:44:22.759061 30220 tablet_service.cc:1467] Processing CreateTablet for tablet 9792c77db78b4d178c0d1c206fcd383f (DEFAULT_TABLE table=test-table [id=74b2ebf2a02148a89417a750d8018c8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:22.760831 30220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9792c77db78b4d178c0d1c206fcd383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:22.762496 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.734927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:55856)
0619 04:44:22.744905 (+ 9978us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.744923 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.745019 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.753800 (+ 8781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.753805 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.753833 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:22.754206 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.754218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.756250 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.756255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.759166 (+ 2911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.759187 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.761668 (+ 2481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.761675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.761851 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.761886 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.761976 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.762124 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9845,"thread_start_us":10166,"threads_started":1}
I20260619 04:44:22.763703 30432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.735567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55856 (local address 127.9.224.65:45915)
0619 04:44:22.752840 (+ 17273us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.752856 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.752888 (+ 32us) server_negotiation.cc:407] Connection header received
0619 04:44:22.752995 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.753004 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.753270 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.753525 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:22.754477 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.756025 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.759507 (+ 3482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.761049 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.761190 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.761488 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.762873 (+ 1385us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.763163 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":307,"threads_started":1}
I20260619 04:44:22.768496 30089 tablet_service.cc:1467] Processing CreateTablet for tablet 9792c77db78b4d178c0d1c206fcd383f (DEFAULT_TABLE table=test-table [id=74b2ebf2a02148a89417a750d8018c8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 04:44:22.769011 30433 tablet_bootstrap.cc:492] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Bootstrap starting.
I20260619 04:44:22.770161 30089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9792c77db78b4d178c0d1c206fcd383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:22.773203 30433 tablet_bootstrap.cc:654] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:22.774310 30433 log.cc:824] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:22.776358 30435 tablet_bootstrap.cc:492] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Bootstrap starting.
I20260619 04:44:22.777519 30433 tablet_bootstrap.cc:492] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: No bootstrap required, opened a new log
I20260619 04:44:22.777812 30433 ts_tablet_manager.cc:1397] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.003s
I20260619 04:44:22.780138 30435 tablet_bootstrap.cc:654] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:22.781805 30435 log.cc:824] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:22.784180 30437 tablet_bootstrap.cc:492] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Bootstrap starting.
I20260619 04:44:22.785267 30435 tablet_bootstrap.cc:492] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: No bootstrap required, opened a new log
I20260619 04:44:22.785548 30435 ts_tablet_manager.cc:1397] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 04:44:22.787277 30437 tablet_bootstrap.cc:654] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:22.788420 30437 log.cc:824] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:22.788869 30433 raft_consensus.cc:348] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.789346 30433 raft_consensus.cc:374] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:22.789449 30433 raft_consensus.cc:729] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fcdf9015214435a8fd53e9a400e9c6e, State: Initialized, Role: FOLLOWER
I20260619 04:44:22.790133 30433 consensus_queue.cc:260] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.795161 30415 heartbeater.cc:503] Master 127.9.224.126:36575 was elected leader, sending a full tablet report...
I20260619 04:44:22.795981 30433 ts_tablet_manager.cc:1428] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260619 04:44:22.797945 30437 tablet_bootstrap.cc:492] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: No bootstrap required, opened a new log
I20260619 04:44:22.798298 30437 ts_tablet_manager.cc:1397] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260619 04:44:22.798146 30435 raft_consensus.cc:348] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.798702 30435 raft_consensus.cc:374] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:22.798807 30435 raft_consensus.cc:729] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93e1cf7674aa4bd4a41b0869f674cffd, State: Initialized, Role: FOLLOWER
I20260619 04:44:22.799499 30435 consensus_queue.cc:260] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.800691 30285 heartbeater.cc:503] Master 127.9.224.126:36575 was elected leader, sending a full tablet report...
I20260619 04:44:22.801585 30435 ts_tablet_manager.cc:1428] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260619 04:44:22.807220 30437 raft_consensus.cc:348] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.807617 30437 raft_consensus.cc:374] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:22.807731 30437 raft_consensus.cc:729] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbedcd78f43f4d6e9b11629ae2a1e4aa, State: Initialized, Role: FOLLOWER
I20260619 04:44:22.808419 30437 consensus_queue.cc:260] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.810122 30437 ts_tablet_manager.cc:1428] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260619 04:44:22.896101 30441 raft_consensus.cc:482] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 04:44:22.896426 30441 raft_consensus.cc:504] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.898329 30441 leader_election.cc:288] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fcdf9015214435a8fd53e9a400e9c6e (127.9.224.67:46633), 93e1cf7674aa4bd4a41b0869f674cffd (127.9.224.66:34481)
I20260619 04:44:22.904877 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.899161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:35019 (local address 127.9.224.66:34481)
0619 04:44:22.899393 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.899399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.899617 (+ 218us) server_negotiation.cc:407] Connection header received
0619 04:44:22.899964 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.899973 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.900058 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.900153 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:22.900669 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.901378 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.903252 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.904005 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.904179 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.904250 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.904493 (+ 243us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.904612 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 04:44:22.905004 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.898660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.66:34481 (local address 127.9.224.65:35019)
0619 04:44:22.899514 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.899533 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.899730 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.900175 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.900179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.900206 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:22.900542 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.900551 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.901501 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.901509 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.903074 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.903086 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.904183 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.904189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.904342 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.904366 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.904466 (+ 100us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.904593 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":2,"thread_start_us":733,"threads_started":1}
I20260619 04:44:22.905337 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.898691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.224.65:55011 (local address 127.9.224.67:46633)
0619 04:44:22.898934 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.898945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.900300 (+ 1355us) server_negotiation.cc:407] Connection header received
0619 04:44:22.900518 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.900522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.900582 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.900672 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 04:44:22.901200 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.901884 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.903705 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.904461 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.904647 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.904714 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.904972 (+ 258us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.905101 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:44:22.905983 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.898721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.67:46633 (local address 127.9.224.65:55011)
0619 04:44:22.900175 (+ 1454us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:22.900194 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:44:22.900372 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:44:22.900696 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:44:22.900700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:44:22.900732 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 04:44:22.901039 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.901047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.902023 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.902033 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.903530 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:44:22.903542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.904650 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.904656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:44:22.904816 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.904839 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 04:44:22.905523 (+ 684us) client_negotiation.cc:240] Negotiation successful
0619 04:44:22.905656 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1343,"mutex_wait_us":41,"thread_start_us":1143,"threads_started":1}
I20260619 04:44:22.906338 30240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9792c77db78b4d178c0d1c206fcd383f" candidate_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" is_pre_election: true
I20260619 04:44:22.906901 30240 raft_consensus.cc:2454] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbedcd78f43f4d6e9b11629ae2a1e4aa in term 0.
I20260619 04:44:22.906977 30370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9792c77db78b4d178c0d1c206fcd383f" candidate_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" is_pre_election: true
I20260619 04:44:22.907486 30370 raft_consensus.cc:2454] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbedcd78f43f4d6e9b11629ae2a1e4aa in term 0.
I20260619 04:44:22.907554 30043 leader_election.cc:302] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93e1cf7674aa4bd4a41b0869f674cffd, bbedcd78f43f4d6e9b11629ae2a1e4aa; no voters:
I20260619 04:44:22.908012 30441 raft_consensus.cc:2781] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 04:44:22.908177 30441 raft_consensus.cc:482] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 04:44:22.908286 30441 raft_consensus.cc:3037] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:22.911019 30441 raft_consensus.cc:504] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.911763 30441 leader_election.cc:288] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [CANDIDATE]: Term 1 election: Requested vote from peers 2fcdf9015214435a8fd53e9a400e9c6e (127.9.224.67:46633), 93e1cf7674aa4bd4a41b0869f674cffd (127.9.224.66:34481)
I20260619 04:44:22.912326 30370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9792c77db78b4d178c0d1c206fcd383f" candidate_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fcdf9015214435a8fd53e9a400e9c6e"
I20260619 04:44:22.912581 30370 raft_consensus.cc:3037] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:22.913134 30240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9792c77db78b4d178c0d1c206fcd383f" candidate_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e1cf7674aa4bd4a41b0869f674cffd"
I20260619 04:44:22.913403 30240 raft_consensus.cc:3037] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:22.915117 30370 raft_consensus.cc:2454] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbedcd78f43f4d6e9b11629ae2a1e4aa in term 1.
I20260619 04:44:22.915557 30044 leader_election.cc:302] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fcdf9015214435a8fd53e9a400e9c6e, bbedcd78f43f4d6e9b11629ae2a1e4aa; no voters:
I20260619 04:44:22.915892 30441 raft_consensus.cc:2781] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:22.916193 30240 raft_consensus.cc:2454] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbedcd78f43f4d6e9b11629ae2a1e4aa in term 1.
I20260619 04:44:22.916396 30441 raft_consensus.cc:686] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 1 LEADER]: Becoming Leader. State: Replica: bbedcd78f43f4d6e9b11629ae2a1e4aa, State: Running, Role: LEADER
I20260619 04:44:22.916980 30441 consensus_queue.cc:237] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } }
I20260619 04:44:22.922101 29968 catalog_manager.cc:5495] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa reported cstate change: term changed from 0 to 1, leader changed from <none> to bbedcd78f43f4d6e9b11629ae2a1e4aa (127.9.224.65). New cstate: current_term: 1 leader_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbedcd78f43f4d6e9b11629ae2a1e4aa" member_type: VOTER last_known_addr { host: "127.9.224.65" port: 45915 } health_report { overall_health: HEALTHY } } }
W20260619 04:44:22.924319 30416 tablet.cc:2369] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:22.955853 30432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:22.950426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55864 (local address 127.9.224.65:45915)
0619 04:44:22.950633 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:22.950638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:22.950682 (+ 44us) server_negotiation.cc:407] Connection header received
0619 04:44:22.950918 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:22.950923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:22.951041 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:22.951256 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:44:22.951609 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.952357 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.953728 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:22.954139 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:22.954306 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:22.954735 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:44:22.955262 (+ 527us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:44:22.955409 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:22.955554 (+ 145us) server_negotiation.cc:299] Negotiation successful
0619 04:44:22.955619 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260619 04:44:22.962901 30155 tablet.cc:2369] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:22.964938 30370 raft_consensus.cc:1261] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 1 FOLLOWER]: Refusing update from remote peer bbedcd78f43f4d6e9b11629ae2a1e4aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:22.965011 30240 raft_consensus.cc:1261] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 1 FOLLOWER]: Refusing update from remote peer bbedcd78f43f4d6e9b11629ae2a1e4aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:44:22.965997 30444 consensus_queue.cc:1035] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fcdf9015214435a8fd53e9a400e9c6e" member_type: VOTER last_known_addr { host: "127.9.224.67" port: 46633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:44:22.966398 30441 consensus_queue.cc:1035] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "93e1cf7674aa4bd4a41b0869f674cffd" member_type: VOTER last_known_addr { host: "127.9.224.66" port: 34481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 04:44:22.967962 30286 tablet.cc:2369] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:44:22.979785 30449 mvcc.cc:205] Tried to move back new op lower bound from 7298434101092315136 to 7298434100911636480. Current Snapshot: MvccSnapshot[applied={T|T < 7298434101092315136}]
I20260619 04:44:22.982398 30448 mvcc.cc:205] Tried to move back new op lower bound from 7298434101092315136 to 7298434100911636480. Current Snapshot: MvccSnapshot[applied={T|T < 7298434101092315136}]
I20260619 04:44:23.001899 29968 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:23.002276 29968 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 04:44:23.007594 29968 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56a132383d534623844cb025e44147bb: Sending DeleteTablet for 3 replicas of tablet 9792c77db78b4d178c0d1c206fcd383f
I20260619 04:44:23.008939 30220 tablet_service.cc:1514] Processing DeleteTablet for tablet 9792c77db78b4d178c0d1c206fcd383f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:23 UTC) from {username='slave'} at 127.0.0.1:55610
I20260619 04:44:23.009057 30350 tablet_service.cc:1514] Processing DeleteTablet for tablet 9792c77db78b4d178c0d1c206fcd383f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:23 UTC) from {username='slave'} at 127.0.0.1:45012
I20260619 04:44:23.010545 30089 tablet_service.cc:1514] Processing DeleteTablet for tablet 9792c77db78b4d178c0d1c206fcd383f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 04:44:23 UTC) from {username='slave'} at 127.0.0.1:55856
I20260619 04:44:23.019104 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30027
I20260619 04:44:23.020251 30457 tablet_replica.cc:330] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: stopping tablet replica
I20260619 04:44:23.021762 30458 tablet_replica.cc:330] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: stopping tablet replica
I20260619 04:44:23.022590 30458 raft_consensus.cc:2229] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 1 LEADER]: Raft consensus shutting down.
I20260619 04:44:23.023284 30457 raft_consensus.cc:2229] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:23.024632 30458 raft_consensus.cc:2258] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:23.025478 30456 tablet_replica.cc:330] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: stopping tablet replica
I20260619 04:44:23.025906 30457 raft_consensus.cc:2258] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:23.026849 30456 raft_consensus.cc:2229] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 04:44:23.029990 30457 ts_tablet_manager.cc:1905] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:23.031395 30456 raft_consensus.cc:2258] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 04:44:23.032627 30458 ts_tablet_manager.cc:1905] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:23.036222 30456 ts_tablet_manager.cc:1905] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 04:44:23.040182 30432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.020414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55866 (local address 127.9.224.65:45915)
0619 04:44:23.020591 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:23.020597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:23.021331 (+ 734us) server_negotiation.cc:407] Connection header received
0619 04:44:23.021406 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:23.021412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:23.021552 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:23.021660 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:23.025765 (+ 4105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:23.027031 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:23.029034 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:23.029838 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:23.030017 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:23.037566 (+ 7549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:23.037579 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:23.037597 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:23.038522 (+ 925us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:23.038593 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:23.038622 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:23.038798 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:23.039593 (+ 795us) server_negotiation.cc:299] Negotiation successful
0619 04:44:23.039710 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:44:23.040982 30149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:23.048352 30457 ts_tablet_manager.cc:1918] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:23.048563 30457 log.cc:1196] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-2/wal/wals/9792c77db78b4d178c0d1c206fcd383f
I20260619 04:44:23.049083 30457 ts_tablet_manager.cc:1939] T 9792c77db78b4d178c0d1c206fcd383f P 2fcdf9015214435a8fd53e9a400e9c6e: Deleting consensus metadata
I20260619 04:44:23.050980 29954 catalog_manager.cc:4841] TS 2fcdf9015214435a8fd53e9a400e9c6e (127.9.224.67:46633): tablet 9792c77db78b4d178c0d1c206fcd383f (table test-table [id=74b2ebf2a02148a89417a750d8018c8d]) successfully deleted
I20260619 04:44:23.053399 30456 ts_tablet_manager.cc:1918] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:23.053598 30456 log.cc:1196] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-1/wal/wals/9792c77db78b4d178c0d1c206fcd383f
I20260619 04:44:23.054064 30456 ts_tablet_manager.cc:1939] T 9792c77db78b4d178c0d1c206fcd383f P 93e1cf7674aa4bd4a41b0869f674cffd: Deleting consensus metadata
I20260619 04:44:23.055722 29953 catalog_manager.cc:4841] TS 93e1cf7674aa4bd4a41b0869f674cffd (127.9.224.66:34481): tablet 9792c77db78b4d178c0d1c206fcd383f (table test-table [id=74b2ebf2a02148a89417a750d8018c8d]) successfully deleted
I20260619 04:44:23.176272 30458 ts_tablet_manager.cc:1918] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 04:44:23.176535 30458 log.cc:1196] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Deleting WAL directory at /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781843940819459-10113-0/minicluster-data/ts-0/wal/wals/9792c77db78b4d178c0d1c206fcd383f
I20260619 04:44:23.177217 30458 ts_tablet_manager.cc:1939] T 9792c77db78b4d178c0d1c206fcd383f P bbedcd78f43f4d6e9b11629ae2a1e4aa: Deleting consensus metadata
I20260619 04:44:23.178692 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30027
W20260619 04:44:23.197857 29954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.224.65:45915 (error 108)
I20260619 04:44:23.199352 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30158
I20260619 04:44:23.200021 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.199464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:55872)
0619 04:44:23.199673 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.199841 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260619 04:44:23.200490 29954 catalog_manager.cc:4584] TS bbedcd78f43f4d6e9b11629ae2a1e4aa (127.9.224.65:45915): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9792c77db78b4d178c0d1c206fcd383f: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
I20260619 04:44:23.208035 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.200478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55620 (local address 127.9.224.66:34481)
0619 04:44:23.200671 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:23.200677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:23.200698 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:44:23.200764 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:23.200769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:23.200891 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:23.200976 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:23.201528 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:23.202386 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:23.204605 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:23.205013 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:23.205112 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:23.206577 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:23.206587 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:23.206601 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:23.207195 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:23.207242 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:23.207262 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:23.207411 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:23.207626 (+ 215us) server_negotiation.cc:299] Negotiation successful
0619 04:44:23.207723 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 04:44:23.208735 30280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:23.254480 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.253889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:55880)
0619 04:44:23.254151 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.254285 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260619 04:44:23.255692 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.255283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:55890)
0619 04:44:23.255452 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.255538 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260619 04:44:23.299356 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30158
I20260619 04:44:23.316182 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.315669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:55892)
0619 04:44:23.315888 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.315985 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260619 04:44:23.317700 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.317267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:55894)
0619 04:44:23.317480 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.317563 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260619 04:44:23.318907 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30288
I20260619 04:44:23.325903 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.319728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45028 (local address 127.9.224.67:46633)
0619 04:44:23.319963 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:23.319970 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:23.319991 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:44:23.320104 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:23.320110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:23.320206 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:23.320325 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:23.320704 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:23.321428 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:23.322765 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:23.323184 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:23.323321 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:23.324480 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:23.324490 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:23.324504 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:23.325114 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:23.325162 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:23.325182 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:23.325314 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:23.325462 (+ 148us) server_negotiation.cc:299] Negotiation successful
0619 04:44:23.325575 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:44:23.326632 30410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:23.398407 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.397820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:45526)
0619 04:44:23.398063 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.398175 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260619 04:44:23.399551 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:23.399140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.65:45915 (local address 127.0.0.1:45534)
0619 04:44:23.399354 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0619 04:44:23.399431 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.65:45915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260619 04:44:23.416391 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30288
I20260619 04:44:23.433256 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 29937
I20260619 04:44:23.434518 29998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:23.545718 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 29937
2026-06-19T04:44:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2923 ms)
[----------] 6 tests from EncryptionPolicyTest (22474 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:23 dist-test-slave-9dgf krb5kdc[30467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:23 dist-test-slave-9dgf krb5kdc[30467](info): set up 2 sockets
Jun 19 04:44:23 dist-test-slave-9dgf krb5kdc[30467](info): commencing operation
krb5kdc: starting...
W20260619 04:44:24.758996 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:24 dist-test-slave-9dgf krb5kdc[30467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:25.026153 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34295
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:25.361807 30480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:25.362103 30480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:25.362329 30480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:25.369645 30480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:25.369761 30480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:25.369874 30480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:25.369995 30480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:25.370044 30480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:25.380831 30480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34295
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:25.382148 30480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:25.383495 30480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:25.395583 30486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:25.395540 30488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:25.395509 30485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:25.396549 30480 server_base.cc:1034] running on GCE node
I20260619 04:44:25.397312 30480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:25.398844 30480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:25.400041 30480 hybrid_clock.cc:648] HybridClock initialized: now 1781844265400012 us; error 31 us; skew 500 ppm
I20260619 04:44:25.400352 30480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:25 dist-test-slave-9dgf krb5kdc[30467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844265, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:25.403614 30480 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:25.405211 30480 webserver.cc:460] Webserver started at http://127.0.0.1:45975/ using document root <none> and password file <none>
I20260619 04:44:25.405915 30480 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:25.406040 30480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:25.406416 30480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:25.409408 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "040e1ac7d8914206b4e18e6e7442e2d0"
format_stamp: "Formatted at 2026-06-19 04:44:25 on dist-test-slave-9dgf"
server_key: "954e412776e155acd042abb45df7d560"
server_key_iv: "e65f50721928ada6d104e38f20359eba"
server_key_version: "encryptionkey@0"
I20260619 04:44:25.410207 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "040e1ac7d8914206b4e18e6e7442e2d0"
format_stamp: "Formatted at 2026-06-19 04:44:25 on dist-test-slave-9dgf"
server_key: "954e412776e155acd042abb45df7d560"
server_key_iv: "e65f50721928ada6d104e38f20359eba"
server_key_version: "encryptionkey@0"
I20260619 04:44:25.415624 30480 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:44:25.419292 30495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:25.420923 30480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:25.421124 30480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "040e1ac7d8914206b4e18e6e7442e2d0"
format_stamp: "Formatted at 2026-06-19 04:44:25 on dist-test-slave-9dgf"
server_key: "954e412776e155acd042abb45df7d560"
server_key_iv: "e65f50721928ada6d104e38f20359eba"
server_key_version: "encryptionkey@0"
I20260619 04:44:25.421312 30480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:25.453769 30480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:25.458341 30480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:25.458676 30480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:25.477506 30480 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34295
I20260619 04:44:25.477596 30546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34295 every 8 connection(s)
I20260619 04:44:25.479030 30480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:25.481591 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30480
I20260619 04:44:25.481812 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:25.482527 10113 external_mini_cluster.cc:1428] Setting key bf646b0d5ccb7f86fa68819e77ddff4a
I20260619 04:44:25.483400 30547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 04:44:25 dist-test-slave-9dgf krb5kdc[30467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 04:44:25.499969 30547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0: Bootstrap starting.
I20260619 04:44:25.504675 30547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:25.505987 30547 log.cc:824] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:25.508953 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:25.484465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36169 (local address 127.0.0.1:34295)
0619 04:44:25.485240 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:25.485251 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:25.485290 (+ 39us) server_negotiation.cc:407] Connection header received
0619 04:44:25.486933 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:25.486956 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:25.487361 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:25.487703 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:25.489843 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:25.491382 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:25.493415 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:25.494101 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:25.494280 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:25.499545 (+ 5265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:25.499559 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:25.499590 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:25.499647 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:25.504073 (+ 4426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:25.504940 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:25.504948 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:25.504954 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:25.505224 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:25.505743 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:25.505747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:25.505750 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:25.506378 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:25.506713 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:25.507256 (+ 543us) server_negotiation.cc:299] Negotiation successful
0619 04:44:25.507636 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":342,"threads_started":1}
I20260619 04:44:25.509610 30547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0: No bootstrap required, opened a new log
I20260619 04:44:25.513062 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:25.517553 30547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260619 04:44:25.518002 30547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:25.518157 30547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 040e1ac7d8914206b4e18e6e7442e2d0, State: Initialized, Role: FOLLOWER
I20260619 04:44:25.518934 30547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260619 04:44:25.519207 30547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:25.519356 30547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:25.519551 30547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:25.522423 30547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260619 04:44:25.523041 30547 leader_election.cc:302] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 040e1ac7d8914206b4e18e6e7442e2d0; no voters:
I20260619 04:44:25.523764 30547 leader_election.cc:288] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:25.523933 30557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:25.525961 30557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [term 1 LEADER]: Becoming Leader. State: Replica: 040e1ac7d8914206b4e18e6e7442e2d0, State: Running, Role: LEADER
I20260619 04:44:25.526055 30547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:25.526710 30557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260619 04:44:25.533574 30558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } } }
I20260619 04:44:25.534045 30558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:25.534614 30559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 040e1ac7d8914206b4e18e6e7442e2d0. Latest consensus state: current_term: 1 leader_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040e1ac7d8914206b4e18e6e7442e2d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } } }
I20260619 04:44:25.534930 30559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:25.542989 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:25.518014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42025 (local address 127.0.0.1:34295)
0619 04:44:25.518257 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:25.518265 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:25.518701 (+ 436us) server_negotiation.cc:407] Connection header received
0619 04:44:25.518959 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:25.518964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:25.519034 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:25.519153 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:25.520986 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:25.521907 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:25.523807 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:25.524828 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:25.525593 (+ 765us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:25.528367 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:25.528371 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:25.528375 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:25.528409 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:25.537060 (+ 8651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:25.538649 (+ 1589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:25.538658 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:25.538665 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:25.538869 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:25.539637 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:25.539646 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:25.539652 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:25.540153 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:25.540544 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:25.542076 (+ 1532us) server_negotiation.cc:299] Negotiation successful
0619 04:44:25.542359 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 04:44:25.547345 30564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:25.555063 30564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:25.565770 30564 catalog_manager.cc:1347] Generated new cluster ID: f27a85cd60f2440282955de222256d46
I20260619 04:44:25.565905 30564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:25.578939 30564 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:25.580281 30564 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:25.597656 30564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 040e1ac7d8914206b4e18e6e7442e2d0: Generated new TSK 0
I20260619 04:44:25.598904 30564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:25.608050 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30480
I20260619 04:44:25.609360 30542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:25.703464 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30480
W20260619 04:44:25.721052 30465 connection.cc:535] client connection to 127.0.0.1:34295 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34295): Connection reset by peer (error 104)
2026-06-19T04:44:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2148 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:25 dist-test-slave-9dgf krb5kdc[30579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:25 dist-test-slave-9dgf krb5kdc[30579](info): set up 2 sockets
Jun 19 04:44:25 dist-test-slave-9dgf krb5kdc[30579](info): commencing operation
krb5kdc: starting...
W20260619 04:44:26.830821 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.004s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:27 dist-test-slave-9dgf krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:27.101231 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:27.446449 30592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:27.446811 30592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:27.446915 30592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:27.454586 30592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:27.454743 30592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:27.454797 30592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:27.454872 30592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:27.454965 30592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:27.465541 30592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44737
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:27.467000 30592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:27.468406 30592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:27.481155 30598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:27.481258 30600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:27.481200 30597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:27.482123 30592 server_base.cc:1034] running on GCE node
I20260619 04:44:27.482996 30592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:27.484468 30592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:27.485694 30592 hybrid_clock.cc:648] HybridClock initialized: now 1781844267485644 us; error 37 us; skew 500 ppm
I20260619 04:44:27.486107 30592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:27 dist-test-slave-9dgf krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:27.489467 30592 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:27.491093 30592 webserver.cc:460] Webserver started at http://127.0.0.1:40507/ using document root <none> and password file <none>
I20260619 04:44:27.491729 30592 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:27.491839 30592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:27.492092 30592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:27.495061 30592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "57607ec8e82349c8a793e291e119425c"
format_stamp: "Formatted at 2026-06-19 04:44:27 on dist-test-slave-9dgf"
server_key: "bf28350347ab120431f7569e9949fb0a"
server_key_iv: "5395d81ce64a52877ac8b7d959377093"
server_key_version: "encryptionkey@0"
I20260619 04:44:27.495769 30592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "57607ec8e82349c8a793e291e119425c"
format_stamp: "Formatted at 2026-06-19 04:44:27 on dist-test-slave-9dgf"
server_key: "bf28350347ab120431f7569e9949fb0a"
server_key_iv: "5395d81ce64a52877ac8b7d959377093"
server_key_version: "encryptionkey@0"
I20260619 04:44:27.500924 30592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:27.504549 30607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:27.505937 30592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:44:27.506136 30592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "57607ec8e82349c8a793e291e119425c"
format_stamp: "Formatted at 2026-06-19 04:44:27 on dist-test-slave-9dgf"
server_key: "bf28350347ab120431f7569e9949fb0a"
server_key_iv: "5395d81ce64a52877ac8b7d959377093"
server_key_version: "encryptionkey@0"
I20260619 04:44:27.506422 30592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:27.541285 30592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:27.545917 30592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:27.546160 30592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:27.565193 30592 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44737
I20260619 04:44:27.565234 30658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44737 every 8 connection(s)
I20260619 04:44:27.566745 30592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:27.567248 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30592
I20260619 04:44:27.567480 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:27.568145 10113 external_mini_cluster.cc:1428] Setting key 95021f296d81382e1bdd7cb4b363d120
I20260619 04:44:27.571163 30659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:27.582214 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:27.570329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47277 (local address 127.0.0.1:44737)
0619 04:44:27.571290 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:27.571307 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:27.571362 (+ 55us) server_negotiation.cc:407] Connection header received
0619 04:44:27.572972 (+ 1610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:27.572993 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:27.573398 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:27.573744 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:27.574366 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:27.575718 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:27.577632 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:27.578361 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:27.578543 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:27.579791 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:27.579798 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:27.579812 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:27.580404 (+ 592us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:27.580514 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:27.580539 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:27.580653 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:27.580991 (+ 338us) server_negotiation.cc:299] Negotiation successful
0619 04:44:27.581189 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":417,"threads_started":1}
I20260619 04:44:27.583758 30659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c: Bootstrap starting.
I20260619 04:44:27.586575 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:27.587484 30659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:27.588730 30659 log.cc:824] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:27.592165 30659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c: No bootstrap required, opened a new log
I20260619 04:44:27.599006 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:27.591847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55667 (local address 127.0.0.1:44737)
0619 04:44:27.592025 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:27.592031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:27.592432 (+ 401us) server_negotiation.cc:407] Connection header received
0619 04:44:27.592576 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:27.592582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:27.592670 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:27.592817 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:27.593348 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:27.594542 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:27.595904 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:27.596629 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:27.596772 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:27.598042 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:27.598049 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:27.598054 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:27.598083 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:27.598151 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:27.598173 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:27.598320 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:27.598579 (+ 259us) server_negotiation.cc:299] Negotiation successful
0619 04:44:27.598643 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:44:27.602020 30659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57607ec8e82349c8a793e291e119425c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44737 } }
I20260619 04:44:27.602582 30659 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:27.602692 30659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57607ec8e82349c8a793e291e119425c, State: Initialized, Role: FOLLOWER
I20260619 04:44:27.603344 30659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57607ec8e82349c8a793e291e119425c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44737 } }
I20260619 04:44:27.603585 30659 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:27.603739 30659 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:27.603937 30659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:27.606638 30659 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57607ec8e82349c8a793e291e119425c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44737 } }
I20260619 04:44:27.607116 30659 leader_election.cc:302] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57607ec8e82349c8a793e291e119425c; no voters:
I20260619 04:44:27.607698 30659 leader_election.cc:288] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:27.607890 30669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:27.609505 30669 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [term 1 LEADER]: Becoming Leader. State: Replica: 57607ec8e82349c8a793e291e119425c, State: Running, Role: LEADER
I20260619 04:44:27.610021 30659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:27.610272 30669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57607ec8e82349c8a793e291e119425c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44737 } }
I20260619 04:44:27.613358 30671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57607ec8e82349c8a793e291e119425c. Latest consensus state: current_term: 1 leader_uuid: "57607ec8e82349c8a793e291e119425c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57607ec8e82349c8a793e291e119425c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44737 } } }
I20260619 04:44:27.613468 30670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57607ec8e82349c8a793e291e119425c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57607ec8e82349c8a793e291e119425c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44737 } } }
I20260619 04:44:27.613747 30671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:27.613758 30670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:27.615810 30679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:27.620368 30679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:27.628983 30679 catalog_manager.cc:1347] Generated new cluster ID: 6783f1e0d54b461990cdd4e8bb9bbc33
I20260619 04:44:27.629156 30679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:27.638154 30679 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:27.640146 30679 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:27.647945 30679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57607ec8e82349c8a793e291e119425c: Generated new TSK 0
I20260619 04:44:27.649044 30679 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:27.659878 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30592
W20260619 04:44:27.661262 30654 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47277
W20260619 04:44:27.662098 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30592: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:27.662304 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30592
W20260619 04:44:27.679448 30577 connection.cc:535] client connection to 127.0.0.1:44737 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44737): Connection reset by peer (error 104)
2026-06-19T04:44:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1957 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:27 dist-test-slave-9dgf krb5kdc[30690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:27 dist-test-slave-9dgf krb5kdc[30690](info): set up 2 sockets
Jun 19 04:44:27 dist-test-slave-9dgf krb5kdc[30690](info): commencing operation
krb5kdc: starting...
W20260619 04:44:28.778695 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.008s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:28 dist-test-slave-9dgf krb5kdc[30690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:29.041751 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43443
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:29.384686 30703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:29.385066 30703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:29.385255 30703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:29.392844 30703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:29.393025 30703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:29.393152 30703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:29.393280 30703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:29.393373 30703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:29.403882 30703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43443
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:29.405403 30703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:29.406927 30703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:29.419689 30708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:29.419759 30709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:29.419734 30711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:29.420818 30703 server_base.cc:1034] running on GCE node
I20260619 04:44:29.421703 30703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:29.423368 30703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:29.424642 30703 hybrid_clock.cc:648] HybridClock initialized: now 1781844269424587 us; error 45 us; skew 500 ppm
I20260619 04:44:29.425062 30703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:29 dist-test-slave-9dgf krb5kdc[30690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844269, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:29.432654 30703 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:29.434702 30703 webserver.cc:460] Webserver started at http://127.0.0.1:38051/ using document root <none> and password file <none>
I20260619 04:44:29.435518 30703 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:29.435693 30703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:29.436079 30703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:29.439579 30703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "f263f3da47594f1387f8da593cf445a4"
format_stamp: "Formatted at 2026-06-19 04:44:29 on dist-test-slave-9dgf"
server_key: "57edfca3e672a4b011522b65db4fc5ec"
server_key_iv: "ecc00ef75d66743833e19b6e5eebf768"
server_key_version: "encryptionkey@0"
I20260619 04:44:29.440491 30703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "f263f3da47594f1387f8da593cf445a4"
format_stamp: "Formatted at 2026-06-19 04:44:29 on dist-test-slave-9dgf"
server_key: "57edfca3e672a4b011522b65db4fc5ec"
server_key_iv: "ecc00ef75d66743833e19b6e5eebf768"
server_key_version: "encryptionkey@0"
I20260619 04:44:29.446368 30703 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 04:44:29.450119 30718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:29.451709 30703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:29.451938 30703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "f263f3da47594f1387f8da593cf445a4"
format_stamp: "Formatted at 2026-06-19 04:44:29 on dist-test-slave-9dgf"
server_key: "57edfca3e672a4b011522b65db4fc5ec"
server_key_iv: "ecc00ef75d66743833e19b6e5eebf768"
server_key_version: "encryptionkey@0"
I20260619 04:44:29.452167 30703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:29.458377 30703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:29.462724 30703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:29.463048 30703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:29.481844 30703 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43443
I20260619 04:44:29.481886 30769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43443 every 8 connection(s)
I20260619 04:44:29.483381 30703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:29.487102 30770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:29.487283 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30703
I20260619 04:44:29.487505 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:29.487972 10113 external_mini_cluster.cc:1428] Setting key 7dc7d689cc588e9a3b78014ff165efc6
I20260619 04:44:29.496583 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:29.489784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33819 (local address 127.0.0.1:43443)
0619 04:44:29.490725 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:29.490740 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:29.490790 (+ 50us) server_negotiation.cc:407] Connection header received
0619 04:44:29.492418 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:29.492456 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:29.492980 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:29.493482 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:29.494553 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:29.494561 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:29.494579 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:29.494597 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:29.494677 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:29.494707 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:29.494935 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:29.495099 (+ 164us) server_negotiation.cc:299] Negotiation successful
0619 04:44:29.495314 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":390,"threads_started":1}
I20260619 04:44:29.500685 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:29.502380 30770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4: Bootstrap starting.
I20260619 04:44:29.505825 30770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:29.507066 30770 log.cc:824] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:29.507768 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:29.505227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41561 (local address 127.0.0.1:43443)
0619 04:44:29.505410 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:29.505416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:29.505749 (+ 333us) server_negotiation.cc:407] Connection header received
0619 04:44:29.505884 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:29.505890 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:29.505968 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:29.506084 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:29.507021 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:29.507026 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:29.507031 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:29.507054 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:29.507102 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:29.507122 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:29.507237 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:29.507369 (+ 132us) server_negotiation.cc:299] Negotiation successful
0619 04:44:29.507423 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:44:29.510200 30770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4: No bootstrap required, opened a new log
I20260619 04:44:29.517959 30770 raft_consensus.cc:348] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f263f3da47594f1387f8da593cf445a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43443 } }
I20260619 04:44:29.518428 30770 raft_consensus.cc:374] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:29.518559 30770 raft_consensus.cc:729] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f263f3da47594f1387f8da593cf445a4, State: Initialized, Role: FOLLOWER
I20260619 04:44:29.519170 30770 consensus_queue.cc:260] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f263f3da47594f1387f8da593cf445a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43443 } }
I20260619 04:44:29.519420 30770 raft_consensus.cc:388] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:29.519579 30770 raft_consensus.cc:482] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:29.519765 30770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:29.522387 30770 raft_consensus.cc:504] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f263f3da47594f1387f8da593cf445a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43443 } }
I20260619 04:44:29.522863 30770 leader_election.cc:302] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f263f3da47594f1387f8da593cf445a4; no voters:
I20260619 04:44:29.523414 30770 leader_election.cc:288] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:29.523571 30780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:29.524297 30780 raft_consensus.cc:686] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [term 1 LEADER]: Becoming Leader. State: Replica: f263f3da47594f1387f8da593cf445a4, State: Running, Role: LEADER
I20260619 04:44:29.524840 30780 consensus_queue.cc:237] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f263f3da47594f1387f8da593cf445a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43443 } }
I20260619 04:44:29.525547 30770 sys_catalog.cc:564] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:29.528079 30782 sys_catalog.cc:455] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f263f3da47594f1387f8da593cf445a4. Latest consensus state: current_term: 1 leader_uuid: "f263f3da47594f1387f8da593cf445a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f263f3da47594f1387f8da593cf445a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43443 } } }
I20260619 04:44:29.528483 30782 sys_catalog.cc:458] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:29.528956 30781 sys_catalog.cc:455] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f263f3da47594f1387f8da593cf445a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f263f3da47594f1387f8da593cf445a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43443 } } }
I20260619 04:44:29.529241 30781 sys_catalog.cc:458] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:29.533581 30788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:29.538522 30788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:29.547331 30788 catalog_manager.cc:1347] Generated new cluster ID: e77f6c848d9840818869bf1540d5fd7f
I20260619 04:44:29.547489 30788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:29.568692 30788 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:29.569175 30788 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:29.584765 30788 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f263f3da47594f1387f8da593cf445a4: Generated new TSK 0
I20260619 04:44:29.585906 30788 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:29.598078 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30703
W20260619 04:44:29.599232 30765 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33819
W20260619 04:44:29.600101 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30703: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:29.600270 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30703
2026-06-19T04:44:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1938 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:29 dist-test-slave-9dgf krb5kdc[30801](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:29 dist-test-slave-9dgf krb5kdc[30801](info): set up 2 sockets
Jun 19 04:44:29 dist-test-slave-9dgf krb5kdc[30801](info): commencing operation
krb5kdc: starting...
W20260619 04:44:30.710978 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:30 dist-test-slave-9dgf krb5kdc[30801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:30.981895 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43715
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:31.314852 30814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:31.315163 30814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:31.315326 30814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:31.322851 30814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:31.322988 30814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:31.323117 30814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:31.323237 30814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:31.323299 30814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:31.333424 30814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:31.334803 30814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:31.336145 30814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:31.348603 30820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:31.348659 30819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:31.348634 30822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:31.349444 30814 server_base.cc:1034] running on GCE node
I20260619 04:44:31.350303 30814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:31.351831 30814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:31.353050 30814 hybrid_clock.cc:648] HybridClock initialized: now 1781844271353004 us; error 38 us; skew 500 ppm
I20260619 04:44:31.353432 30814 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:31 dist-test-slave-9dgf krb5kdc[30801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844271, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:31.356662 30814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:31.358197 30814 webserver.cc:460] Webserver started at http://127.0.0.1:33827/ using document root <none> and password file <none>
I20260619 04:44:31.358928 30814 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:31.359040 30814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:31.359287 30814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:31.362211 30814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "ff28fccbc26e46768bac7eeb2287a9ba"
format_stamp: "Formatted at 2026-06-19 04:44:31 on dist-test-slave-9dgf"
server_key: "f7d58747ed41b4fad5564ef2aa678df2"
server_key_iv: "718e2c12a18bca2c8e34338892342efe"
server_key_version: "encryptionkey@0"
I20260619 04:44:31.363021 30814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "ff28fccbc26e46768bac7eeb2287a9ba"
format_stamp: "Formatted at 2026-06-19 04:44:31 on dist-test-slave-9dgf"
server_key: "f7d58747ed41b4fad5564ef2aa678df2"
server_key_iv: "718e2c12a18bca2c8e34338892342efe"
server_key_version: "encryptionkey@0"
I20260619 04:44:31.368166 30814 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 04:44:31.371852 30829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:31.373208 30814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:31.373405 30814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "ff28fccbc26e46768bac7eeb2287a9ba"
format_stamp: "Formatted at 2026-06-19 04:44:31 on dist-test-slave-9dgf"
server_key: "f7d58747ed41b4fad5564ef2aa678df2"
server_key_iv: "718e2c12a18bca2c8e34338892342efe"
server_key_version: "encryptionkey@0"
I20260619 04:44:31.373618 30814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:31.399386 30814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:31.403720 30814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:31.404024 30814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:31.424062 30814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43715
I20260619 04:44:31.424101 30880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43715 every 8 connection(s)
I20260619 04:44:31.425508 30814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:31.427498 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30814
I20260619 04:44:31.427686 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:31.428272 10113 external_mini_cluster.cc:1428] Setting key ddffad6dc76b9ed0ff7c64d8804da7d8
I20260619 04:44:31.430529 30881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 04:44:31 dist-test-slave-9dgf krb5kdc[30801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 04:44:31.442523 30881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba: Bootstrap starting.
I20260619 04:44:31.446455 30881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:31.447804 30881 log.cc:824] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:31.451519 30881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba: No bootstrap required, opened a new log
I20260619 04:44:31.451849 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:31.430248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48183 (local address 127.0.0.1:43715)
0619 04:44:31.431137 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:31.431149 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:31.431193 (+ 44us) server_negotiation.cc:407] Connection header received
0619 04:44:31.432802 (+ 1609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:31.432827 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:31.433289 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:31.433757 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:31.435344 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:31.436759 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:31.438069 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:31.438906 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:31.439132 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:31.443642 (+ 4510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:31.443651 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:31.443667 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:31.443705 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:31.446933 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:31.447904 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:31.447910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:31.447940 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:31.448146 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:31.448669 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:31.448674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:31.448677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:31.449461 (+ 784us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:31.449708 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:31.450292 (+ 584us) server_negotiation.cc:299] Negotiation successful
0619 04:44:31.450733 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":386,"threads_started":1}
I20260619 04:44:31.455893 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:31.460345 30881 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43715 } }
I20260619 04:44:31.460878 30881 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:31.461000 30881 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff28fccbc26e46768bac7eeb2287a9ba, State: Initialized, Role: FOLLOWER
I20260619 04:44:31.461738 30881 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43715 } }
I20260619 04:44:31.462052 30881 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:31.462210 30881 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:31.462461 30881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:31.465601 30881 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43715 } }
I20260619 04:44:31.466343 30881 leader_election.cc:302] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff28fccbc26e46768bac7eeb2287a9ba; no voters:
I20260619 04:44:31.466997 30881 leader_election.cc:288] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:31.467142 30891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:31.468557 30891 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [term 1 LEADER]: Becoming Leader. State: Replica: ff28fccbc26e46768bac7eeb2287a9ba, State: Running, Role: LEADER
I20260619 04:44:31.469161 30891 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43715 } }
I20260619 04:44:31.469538 30881 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:31.473340 30892 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43715 } } }
I20260619 04:44:31.473886 30892 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:31.473052 30893 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff28fccbc26e46768bac7eeb2287a9ba. Latest consensus state: current_term: 1 leader_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff28fccbc26e46768bac7eeb2287a9ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43715 } } }
I20260619 04:44:31.480115 30893 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:31.481103 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:31.460422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50685 (local address 127.0.0.1:43715)
0619 04:44:31.460629 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:31.460635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:31.461206 (+ 571us) server_negotiation.cc:407] Connection header received
0619 04:44:31.461446 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:31.461451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:31.461531 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:31.461613 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:31.463675 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:31.464417 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:31.466185 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:31.466888 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:31.467048 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:31.470121 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:31.470127 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:31.470132 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:31.470173 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:31.475751 (+ 5578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:31.476983 (+ 1232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:31.476991 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:31.476997 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:31.477262 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:31.477911 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:31.477919 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:31.477925 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:31.478521 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:31.480155 (+ 1634us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:31.480344 (+ 189us) server_negotiation.cc:299] Negotiation successful
0619 04:44:31.480635 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:44:31.483209 30898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:31.489043 30898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:31.498570 30898 catalog_manager.cc:1347] Generated new cluster ID: d07359b635fa402ab371e8ce864606f7
I20260619 04:44:31.498708 30898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:31.541257 30898 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:31.543107 30898 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:31.557233 30898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff28fccbc26e46768bac7eeb2287a9ba: Generated new TSK 0
I20260619 04:44:31.558391 30898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:31.569546 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30814
I20260619 04:44:31.570791 30876 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:31.668370 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30814
2026-06-19T04:44:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2068 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:31 dist-test-slave-9dgf krb5kdc[30913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:31 dist-test-slave-9dgf krb5kdc[30913](info): set up 2 sockets
Jun 19 04:44:31 dist-test-slave-9dgf krb5kdc[30913](info): commencing operation
krb5kdc: starting...
W20260619 04:44:32.802606 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:32 dist-test-slave-9dgf krb5kdc[30913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:33.069604 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42051
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:33.405009 30926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:33.405310 30926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:33.405516 30926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:33.413010 30926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:33.413137 30926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:33.413230 30926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:33.413321 30926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:33.413363 30926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:33.423856 30926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:33.425275 30926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:33.426807 30926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:33.439527 30931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:33.439638 30934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:33.439662 30932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:33.440776 30926 server_base.cc:1034] running on GCE node
I20260619 04:44:33.441622 30926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:33.443255 30926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:33.444514 30926 hybrid_clock.cc:648] HybridClock initialized: now 1781844273444464 us; error 39 us; skew 500 ppm
I20260619 04:44:33.444985 30926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:33 dist-test-slave-9dgf krb5kdc[30913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:33.448743 30926 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:33.450541 30926 webserver.cc:460] Webserver started at http://127.0.0.1:35361/ using document root <none> and password file <none>
I20260619 04:44:33.451265 30926 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:33.451409 30926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:33.451758 30926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:33.454996 30926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "628934cd613c4d108e50452525fb5fed"
format_stamp: "Formatted at 2026-06-19 04:44:33 on dist-test-slave-9dgf"
server_key: "eaeef4275f9a1a45c9cbddd6d27db2f0"
server_key_iv: "dbd6e90a955da82dfb71b9fac8c31c9c"
server_key_version: "encryptionkey@0"
I20260619 04:44:33.455883 30926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "628934cd613c4d108e50452525fb5fed"
format_stamp: "Formatted at 2026-06-19 04:44:33 on dist-test-slave-9dgf"
server_key: "eaeef4275f9a1a45c9cbddd6d27db2f0"
server_key_iv: "dbd6e90a955da82dfb71b9fac8c31c9c"
server_key_version: "encryptionkey@0"
I20260619 04:44:33.461563 30926 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:44:33.465417 30941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:33.467152 30926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:33.467365 30926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "628934cd613c4d108e50452525fb5fed"
format_stamp: "Formatted at 2026-06-19 04:44:33 on dist-test-slave-9dgf"
server_key: "eaeef4275f9a1a45c9cbddd6d27db2f0"
server_key_iv: "dbd6e90a955da82dfb71b9fac8c31c9c"
server_key_version: "encryptionkey@0"
I20260619 04:44:33.467574 30926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:33.486374 30926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:33.490906 30926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:33.491210 30926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:33.511013 30926 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42051
I20260619 04:44:33.511065 30992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42051 every 8 connection(s)
I20260619 04:44:33.512430 30926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:33.515509 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 30926
I20260619 04:44:33.515693 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:33.516180 10113 external_mini_cluster.cc:1428] Setting key c0c4de0d75b0306fe3e1f7fcf85798da
I20260619 04:44:33.516419 30993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:33.531728 30993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed: Bootstrap starting.
I20260619 04:44:33.531699 30996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:33.518016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56399 (local address 127.0.0.1:42051)
0619 04:44:33.518910 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:33.518926 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:33.518972 (+ 46us) server_negotiation.cc:407] Connection header received
0619 04:44:33.521299 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:33.521329 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:33.521902 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:33.522397 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:33.522961 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:33.525003 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:33.526943 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:33.527698 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:33.527857 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:33.529202 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:33.529210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:33.529225 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:33.529818 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:33.529908 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:33.529935 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:33.530038 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:33.530323 (+ 285us) server_negotiation.cc:299] Negotiation successful
0619 04:44:33.530654 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":399,"threads_started":1}
I20260619 04:44:33.535122 30993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:33.535594 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:33.536243 30993 log.cc:824] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:33.539047 30993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed: No bootstrap required, opened a new log
I20260619 04:44:33.547200 30996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:33.540137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52979 (local address 127.0.0.1:42051)
0619 04:44:33.540359 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:33.540366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:33.540725 (+ 359us) server_negotiation.cc:407] Connection header received
0619 04:44:33.540926 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:33.540930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:33.541017 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:33.541106 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:33.541638 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:33.542470 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:33.544457 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:33.544936 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:33.545064 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:33.546363 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:33.546371 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:33.546375 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:33.546398 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:33.546442 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:33.546460 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:33.546537 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:33.546690 (+ 153us) server_negotiation.cc:299] Negotiation successful
0619 04:44:33.546772 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 04:44:33.549170 30993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "628934cd613c4d108e50452525fb5fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42051 } }
I20260619 04:44:33.549588 30993 raft_consensus.cc:374] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:33.549707 30993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 628934cd613c4d108e50452525fb5fed, State: Initialized, Role: FOLLOWER
I20260619 04:44:33.550455 30993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "628934cd613c4d108e50452525fb5fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42051 } }
I20260619 04:44:33.550696 30993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:33.550832 30993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:33.551011 30993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:33.553225 30993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "628934cd613c4d108e50452525fb5fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42051 } }
I20260619 04:44:33.553772 30993 leader_election.cc:302] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 628934cd613c4d108e50452525fb5fed; no voters:
I20260619 04:44:33.554455 30993 leader_election.cc:288] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:33.554643 31003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:33.555658 31003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [term 1 LEADER]: Becoming Leader. State: Replica: 628934cd613c4d108e50452525fb5fed, State: Running, Role: LEADER
I20260619 04:44:33.556207 31003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "628934cd613c4d108e50452525fb5fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42051 } }
I20260619 04:44:33.556845 30993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:33.559640 31005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 628934cd613c4d108e50452525fb5fed. Latest consensus state: current_term: 1 leader_uuid: "628934cd613c4d108e50452525fb5fed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "628934cd613c4d108e50452525fb5fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42051 } } }
I20260619 04:44:33.559613 31004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "628934cd613c4d108e50452525fb5fed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "628934cd613c4d108e50452525fb5fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42051 } } }
I20260619 04:44:33.560141 31005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:33.560163 31004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:33.562934 31008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:33.569566 31008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:33.578897 31008 catalog_manager.cc:1347] Generated new cluster ID: c86fc338c8c049298263cbebcb3b06aa
I20260619 04:44:33.579031 31008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:33.601930 31008 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:33.603340 31008 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:33.610059 31008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 628934cd613c4d108e50452525fb5fed: Generated new TSK 0
I20260619 04:44:33.610978 31008 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:33.617517 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30926
W20260619 04:44:33.618783 30988 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56399
W20260619 04:44:33.619661 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 30926: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:33.619827 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 30926
2026-06-19T04:44:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1954 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:33 dist-test-slave-9dgf krb5kdc[31024](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:33 dist-test-slave-9dgf krb5kdc[31024](info): set up 2 sockets
Jun 19 04:44:33 dist-test-slave-9dgf krb5kdc[31024](info): commencing operation
krb5kdc: starting...
W20260619 04:44:34.762857 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:34 dist-test-slave-9dgf krb5kdc[31024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:35.030215 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42669
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:35.367664 31037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:35.368041 31037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:35.368242 31037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:35.375577 31037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:35.375747 31037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:35.375860 31037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:35.375980 31037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:35.376070 31037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:35.386953 31037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:35.388335 31037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:35.389671 31037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:35.401793 31043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:35.401715 31042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:35.402199 31045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:35.402839 31037 server_base.cc:1034] running on GCE node
I20260619 04:44:35.403680 31037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:35.405237 31037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:35.406468 31037 hybrid_clock.cc:648] HybridClock initialized: now 1781844275406408 us; error 51 us; skew 500 ppm
I20260619 04:44:35.406837 31037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:35 dist-test-slave-9dgf krb5kdc[31024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:35.416425 31037 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:35.418351 31037 webserver.cc:460] Webserver started at http://127.0.0.1:35199/ using document root <none> and password file <none>
I20260619 04:44:35.419137 31037 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:35.419296 31037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:35.419644 31037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:35.422942 31037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c"
format_stamp: "Formatted at 2026-06-19 04:44:35 on dist-test-slave-9dgf"
server_key: "229e080b2dc46b28b64cdef719ad3ee9"
server_key_iv: "671e03c405fbd82bd190afde349369b9"
server_key_version: "encryptionkey@0"
I20260619 04:44:35.423835 31037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c"
format_stamp: "Formatted at 2026-06-19 04:44:35 on dist-test-slave-9dgf"
server_key: "229e080b2dc46b28b64cdef719ad3ee9"
server_key_iv: "671e03c405fbd82bd190afde349369b9"
server_key_version: "encryptionkey@0"
I20260619 04:44:35.429471 31037 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:44:35.433447 31052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:35.435060 31037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 04:44:35.435304 31037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c"
format_stamp: "Formatted at 2026-06-19 04:44:35 on dist-test-slave-9dgf"
server_key: "229e080b2dc46b28b64cdef719ad3ee9"
server_key_iv: "671e03c405fbd82bd190afde349369b9"
server_key_version: "encryptionkey@0"
I20260619 04:44:35.435531 31037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:35.441687 31037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:35.446223 31037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:35.446614 31037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:35.466398 31037 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42669
I20260619 04:44:35.466442 31103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42669 every 8 connection(s)
I20260619 04:44:35.467916 31037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:35.471853 31104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:35.475684 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31037
I20260619 04:44:35.475884 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:35.476454 10113 external_mini_cluster.cc:1428] Setting key 08b4222107ee41029c66f4dd338714c3
I20260619 04:44:35.484653 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:35.478478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50767 (local address 127.0.0.1:42669)
0619 04:44:35.479387 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:35.479401 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:35.479442 (+ 41us) server_negotiation.cc:407] Connection header received
0619 04:44:35.481112 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:35.481136 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:35.481580 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:35.481944 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:35.483044 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:35.483050 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:35.483063 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:35.483077 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:35.483135 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:35.483153 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:35.483325 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:35.483485 (+ 160us) server_negotiation.cc:299] Negotiation successful
0619 04:44:35.483690 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":453,"threads_started":1}
I20260619 04:44:35.485188 31104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c: Bootstrap starting.
I20260619 04:44:35.488451 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:35.488480 31104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:35.489714 31104 log.cc:824] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:35.493317 31104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c: No bootstrap required, opened a new log
I20260619 04:44:35.496755 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:35.493707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35739 (local address 127.0.0.1:42669)
0619 04:44:35.493912 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:35.493920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:35.494516 (+ 596us) server_negotiation.cc:407] Connection header received
0619 04:44:35.494717 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:35.494722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:35.494785 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:35.495082 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:35.496083 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:35.496098 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:35.496101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:35.496116 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:35.496157 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:35.496172 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:35.496310 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:35.496395 (+ 85us) server_negotiation.cc:299] Negotiation successful
0619 04:44:35.496486 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:44:35.501667 31104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42669 } }
I20260619 04:44:35.502066 31104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:35.502185 31104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8febf2b4b4004e4d8c4e3558e1cd4e0c, State: Initialized, Role: FOLLOWER
I20260619 04:44:35.502981 31104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42669 } }
I20260619 04:44:35.503271 31104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:35.503445 31104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:35.503662 31104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:35.505951 31104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42669 } }
I20260619 04:44:35.506510 31104 leader_election.cc:302] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8febf2b4b4004e4d8c4e3558e1cd4e0c; no voters:
I20260619 04:44:35.507055 31104 leader_election.cc:288] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:35.507225 31114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:35.507885 31114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [term 1 LEADER]: Becoming Leader. State: Replica: 8febf2b4b4004e4d8c4e3558e1cd4e0c, State: Running, Role: LEADER
I20260619 04:44:35.508517 31114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42669 } }
I20260619 04:44:35.509272 31104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:35.515869 31115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42669 } } }
I20260619 04:44:35.516345 31115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:35.516391 31116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8febf2b4b4004e4d8c4e3558e1cd4e0c. Latest consensus state: current_term: 1 leader_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8febf2b4b4004e4d8c4e3558e1cd4e0c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42669 } } }
I20260619 04:44:35.516727 31116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:35.517925 31124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:35.523552 31124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:35.533864 31124 catalog_manager.cc:1347] Generated new cluster ID: 5554c1d08adb4bb49ec6f23f40a4d4e7
I20260619 04:44:35.534018 31124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:35.557675 31124 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:35.558133 31124 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:35.577152 31124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8febf2b4b4004e4d8c4e3558e1cd4e0c: Generated new TSK 0
I20260619 04:44:35.578052 31124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:35.589859 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31037
W20260619 04:44:35.591264 31099 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50767
W20260619 04:44:35.592063 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31037: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:35.592209 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31037
2026-06-19T04:44:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1969 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:35 dist-test-slave-9dgf krb5kdc[31135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:35 dist-test-slave-9dgf krb5kdc[31135](info): set up 2 sockets
Jun 19 04:44:35 dist-test-slave-9dgf krb5kdc[31135](info): commencing operation
krb5kdc: starting...
W20260619 04:44:36.706836 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:36 dist-test-slave-9dgf krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:36.975482 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37885
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:37.311280 31148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:37.311589 31148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:37.311764 31148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:37.319181 31148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:37.319308 31148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:37.319392 31148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:37.319479 31148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:37.319520 31148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:37.329875 31148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:37.331244 31148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:37.332594 31148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:37.344506 31153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:37.344645 31156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:37.344645 31154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:37.345264 31148 server_base.cc:1034] running on GCE node
I20260619 04:44:37.346103 31148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:37.347667 31148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:37.348876 31148 hybrid_clock.cc:648] HybridClock initialized: now 1781844277348826 us; error 39 us; skew 500 ppm
I20260619 04:44:37.349248 31148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:37 dist-test-slave-9dgf krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844277, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:37.352475 31148 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:37.354086 31148 webserver.cc:460] Webserver started at http://127.0.0.1:42031/ using document root <none> and password file <none>
I20260619 04:44:37.354841 31148 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:37.354995 31148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:37.355306 31148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:37.358398 31148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "5815f83f9b724da488346186a61dfc94"
format_stamp: "Formatted at 2026-06-19 04:44:37 on dist-test-slave-9dgf"
server_key: "3add009042833e1415ca2f7343649102"
server_key_iv: "68f2f99201fa4bfe0ab4ea2cc1660497"
server_key_version: "encryptionkey@0"
I20260619 04:44:37.359191 31148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "5815f83f9b724da488346186a61dfc94"
format_stamp: "Formatted at 2026-06-19 04:44:37 on dist-test-slave-9dgf"
server_key: "3add009042833e1415ca2f7343649102"
server_key_iv: "68f2f99201fa4bfe0ab4ea2cc1660497"
server_key_version: "encryptionkey@0"
I20260619 04:44:37.364446 31148 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:37.368039 31163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:37.369403 31148 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:44:37.369601 31148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "5815f83f9b724da488346186a61dfc94"
format_stamp: "Formatted at 2026-06-19 04:44:37 on dist-test-slave-9dgf"
server_key: "3add009042833e1415ca2f7343649102"
server_key_iv: "68f2f99201fa4bfe0ab4ea2cc1660497"
server_key_version: "encryptionkey@0"
I20260619 04:44:37.369810 31148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:37.396677 31148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:37.401077 31148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:37.401379 31148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:37.421432 31148 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37885
I20260619 04:44:37.421466 31214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37885 every 8 connection(s)
I20260619 04:44:37.422981 31148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:37.426913 31215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:37.432008 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31148
I20260619 04:44:37.432214 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:37.432642 10113 external_mini_cluster.cc:1428] Setting key 10f72aba68a9143e3fe00559694ebb28
I20260619 04:44:37.438493 31215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94: Bootstrap starting.
I20260619 04:44:37.441781 31215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:37.442914 31215 log.cc:824] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:37.446657 31215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94: No bootstrap required, opened a new log
Jun 19 04:44:37 dist-test-slave-9dgf krb5kdc[31135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 04:44:37.454635 31215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5815f83f9b724da488346186a61dfc94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260619 04:44:37.455049 31215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:37.455168 31215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5815f83f9b724da488346186a61dfc94, State: Initialized, Role: FOLLOWER
I20260619 04:44:37.455991 31215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5815f83f9b724da488346186a61dfc94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260619 04:44:37.456293 31215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:37.456449 31215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:37.456650 31215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:37.457437 31218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:37.434591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:36835 (local address 127.0.0.1:37885)
0619 04:44:37.435393 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:37.435405 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:37.435446 (+ 41us) server_negotiation.cc:407] Connection header received
0619 04:44:37.437371 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:37.437398 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:37.437842 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:37.438293 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:37.439774 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:37.441138 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:37.442537 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:37.443332 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:37.443545 (+ 213us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:37.448657 (+ 5112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:37.448666 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:37.448681 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:37.448722 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:37.452186 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:37.453156 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:37.453163 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:37.453170 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:37.453357 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:37.453863 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:37.453873 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:37.453875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:37.454479 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:37.454822 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:37.455544 (+ 722us) server_negotiation.cc:299] Negotiation successful
0619 04:44:37.455887 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":341,"threads_started":1}
I20260619 04:44:37.459777 31215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5815f83f9b724da488346186a61dfc94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260619 04:44:37.460335 31215 leader_election.cc:302] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5815f83f9b724da488346186a61dfc94; no voters:
I20260619 04:44:37.461045 31215 leader_election.cc:288] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:37.461217 31220 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:37.462283 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:37.462361 31220 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [term 1 LEADER]: Becoming Leader. State: Replica: 5815f83f9b724da488346186a61dfc94, State: Running, Role: LEADER
I20260619 04:44:37.462940 31220 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5815f83f9b724da488346186a61dfc94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260619 04:44:37.463405 31215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:37.465703 31222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5815f83f9b724da488346186a61dfc94. Latest consensus state: current_term: 1 leader_uuid: "5815f83f9b724da488346186a61dfc94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5815f83f9b724da488346186a61dfc94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } } }
I20260619 04:44:37.465690 31221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5815f83f9b724da488346186a61dfc94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5815f83f9b724da488346186a61dfc94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } } }
I20260619 04:44:37.466150 31222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:37.466150 31221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:37.481230 31226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:37.486534 31226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:37.500250 31226 catalog_manager.cc:1347] Generated new cluster ID: ae706223a7ca4f548869f1188e59f107
I20260619 04:44:37.500387 31226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:37.511466 31218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:37.493643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:47721 (local address 127.0.0.1:37885)
0619 04:44:37.493869 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:37.493878 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:37.494051 (+ 173us) server_negotiation.cc:407] Connection header received
0619 04:44:37.494393 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:37.494402 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:37.494517 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:37.494622 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:37.497292 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:37.498506 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:37.500341 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:37.500980 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:37.501095 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:37.504499 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:37.504505 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:37.504510 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:37.504554 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:37.508137 (+ 3583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:37.509030 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:37.509036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:37.509040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:37.509190 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:37.509698 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:37.509703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:37.509706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:37.510038 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:37.510283 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:37.510917 (+ 634us) server_negotiation.cc:299] Negotiation successful
0619 04:44:37.511092 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:44:37.519420 31226 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:37.520762 31226 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:37.532788 31226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5815f83f9b724da488346186a61dfc94: Generated new TSK 0
I20260619 04:44:37.533922 31226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:37.543133 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31148
I20260619 04:44:37.544284 31210 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:37.635571 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31148
W20260619 04:44:37.652932 31133 connection.cc:535] client connection to 127.0.0.1:37885 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37885): Connection reset by peer (error 104)
2026-06-19T04:44:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2043 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:37 dist-test-slave-9dgf krb5kdc[31247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:37 dist-test-slave-9dgf krb5kdc[31247](info): set up 2 sockets
Jun 19 04:44:37 dist-test-slave-9dgf krb5kdc[31247](info): commencing operation
krb5kdc: starting...
W20260619 04:44:38.754815 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:38 dist-test-slave-9dgf krb5kdc[31247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:39.021835 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34335
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:39.357990 31260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:39.358381 31260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:39.358549 31260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:39.366698 31260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:39.366845 31260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:39.366954 31260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:39.367056 31260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:39.367139 31260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:39.377547 31260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:39.379014 31260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:39.380339 31260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:39.392388 31265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:39.392346 31268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:39.392437 31266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:39.394476 31260 server_base.cc:1034] running on GCE node
I20260619 04:44:39.395421 31260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:39.396974 31260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:39.398207 31260 hybrid_clock.cc:648] HybridClock initialized: now 1781844279398150 us; error 43 us; skew 500 ppm
I20260619 04:44:39.398804 31260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:39 dist-test-slave-9dgf krb5kdc[31247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844279, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:39.402298 31260 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:39.404016 31260 webserver.cc:460] Webserver started at http://127.0.0.1:44105/ using document root <none> and password file <none>
I20260619 04:44:39.404841 31260 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:39.404989 31260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:39.405334 31260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:39.408567 31260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "4f9382b815794c9988e1a9cb2c0c9501"
format_stamp: "Formatted at 2026-06-19 04:44:39 on dist-test-slave-9dgf"
server_key: "ecf724c58f1931f5f1a327bdb741aa45"
server_key_iv: "3b334426455e78af833ebbe4729dd892"
server_key_version: "encryptionkey@0"
I20260619 04:44:39.409365 31260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "4f9382b815794c9988e1a9cb2c0c9501"
format_stamp: "Formatted at 2026-06-19 04:44:39 on dist-test-slave-9dgf"
server_key: "ecf724c58f1931f5f1a327bdb741aa45"
server_key_iv: "3b334426455e78af833ebbe4729dd892"
server_key_version: "encryptionkey@0"
I20260619 04:44:39.415139 31260 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 04:44:39.418993 31275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:39.420504 31260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:39.420715 31260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "4f9382b815794c9988e1a9cb2c0c9501"
format_stamp: "Formatted at 2026-06-19 04:44:39 on dist-test-slave-9dgf"
server_key: "ecf724c58f1931f5f1a327bdb741aa45"
server_key_iv: "3b334426455e78af833ebbe4729dd892"
server_key_version: "encryptionkey@0"
I20260619 04:44:39.420943 31260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:39.446658 31260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:39.450837 31260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:39.451145 31260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:39.470626 31260 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34335
I20260619 04:44:39.470667 31326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34335 every 8 connection(s)
I20260619 04:44:39.472137 31260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:39.476001 31327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:39.478185 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31260
I20260619 04:44:39.478412 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:39.478854 10113 external_mini_cluster.cc:1428] Setting key c6dd0eefa5331bdfdb890d979d6b806f
I20260619 04:44:39.488374 31327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501: Bootstrap starting.
I20260619 04:44:39.492226 31327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:39.493127 31330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:39.480795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:49105 (local address 127.0.0.1:34335)
0619 04:44:39.481670 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:39.481681 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:39.481725 (+ 44us) server_negotiation.cc:407] Connection header received
0619 04:44:39.483475 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:39.483498 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:39.483909 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:39.484246 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:39.484835 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:39.486205 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:39.488134 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:39.489004 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:39.489161 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:39.490598 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:39.490606 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:39.490621 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:39.491204 (+ 583us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:39.491297 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:39.491324 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:39.491472 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:39.491795 (+ 323us) server_negotiation.cc:299] Negotiation successful
0619 04:44:39.492004 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":418,"threads_started":1}
I20260619 04:44:39.493376 31327 log.cc:824] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:39.496631 31327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501: No bootstrap required, opened a new log
I20260619 04:44:39.497398 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:39.504051 31327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9382b815794c9988e1a9cb2c0c9501" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34335 } }
I20260619 04:44:39.504510 31327 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:39.504616 31327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f9382b815794c9988e1a9cb2c0c9501, State: Initialized, Role: FOLLOWER
I20260619 04:44:39.505414 31327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9382b815794c9988e1a9cb2c0c9501" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34335 } }
I20260619 04:44:39.505709 31327 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:39.505900 31327 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:39.506088 31327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:39.508481 31327 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9382b815794c9988e1a9cb2c0c9501" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34335 } }
I20260619 04:44:39.509032 31327 leader_election.cc:302] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f9382b815794c9988e1a9cb2c0c9501; no voters:
I20260619 04:44:39.509763 31327 leader_election.cc:288] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:39.509869 31337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:39.511497 31330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:39.504365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:60069 (local address 127.0.0.1:34335)
0619 04:44:39.504581 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:39.504588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:39.505240 (+ 652us) server_negotiation.cc:407] Connection header received
0619 04:44:39.505515 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:39.505520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:39.505605 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:39.505732 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:39.506404 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:39.507193 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:39.508590 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:39.509109 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:39.509257 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:39.510612 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:39.510618 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:39.510622 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:39.510644 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:39.510688 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:39.510705 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:39.510791 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:39.511096 (+ 305us) server_negotiation.cc:299] Negotiation successful
0619 04:44:39.511150 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:44:39.512629 31327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:39.516865 31337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [term 1 LEADER]: Becoming Leader. State: Replica: 4f9382b815794c9988e1a9cb2c0c9501, State: Running, Role: LEADER
I20260619 04:44:39.517642 31337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9382b815794c9988e1a9cb2c0c9501" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34335 } }
I20260619 04:44:39.521003 31338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f9382b815794c9988e1a9cb2c0c9501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9382b815794c9988e1a9cb2c0c9501" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34335 } } }
I20260619 04:44:39.521129 31339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f9382b815794c9988e1a9cb2c0c9501. Latest consensus state: current_term: 1 leader_uuid: "4f9382b815794c9988e1a9cb2c0c9501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9382b815794c9988e1a9cb2c0c9501" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34335 } } }
I20260619 04:44:39.521440 31338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:39.521497 31339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:39.524343 31350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:39.529485 31350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:39.537978 31350 catalog_manager.cc:1347] Generated new cluster ID: 23cfa7c490b3459c99a3a447abcfb6da
I20260619 04:44:39.538129 31350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:39.552194 31350 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:39.553704 31350 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:39.563290 31350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f9382b815794c9988e1a9cb2c0c9501: Generated new TSK 0
I20260619 04:44:39.564199 31350 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:39.572477 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31260
W20260619 04:44:39.573622 31322 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.206:49105
W20260619 04:44:39.574414 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31260: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:39.574568 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31260
W20260619 04:44:39.591809 31245 connection.cc:535] client connection to 127.0.0.1:34335 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34335): Connection reset by peer (error 104)
2026-06-19T04:44:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1938 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:39 dist-test-slave-9dgf krb5kdc[31358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:39 dist-test-slave-9dgf krb5kdc[31358](info): set up 2 sockets
Jun 19 04:44:39 dist-test-slave-9dgf krb5kdc[31358](info): commencing operation
krb5kdc: starting...
W20260619 04:44:40.682796 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:40 dist-test-slave-9dgf krb5kdc[31358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:40.953013 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40771
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:41.287026 31371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:41.287321 31371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:41.287413 31371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:41.294749 31371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:41.294872 31371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:41.294941 31371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:41.295001 31371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:41.295046 31371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:41.306130 31371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:41.307992 31371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:41.309283 31371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:41.321748 31376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:41.321686 31379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:41.321658 31377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:41.322750 31371 server_base.cc:1034] running on GCE node
I20260619 04:44:41.323668 31371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:41.325340 31371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:41.326593 31371 hybrid_clock.cc:648] HybridClock initialized: now 1781844281326561 us; error 37 us; skew 500 ppm
I20260619 04:44:41.326990 31371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:41 dist-test-slave-9dgf krb5kdc[31358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844281, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:41.333739 31371 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:41.335601 31371 webserver.cc:460] Webserver started at http://127.0.0.1:44103/ using document root <none> and password file <none>
I20260619 04:44:41.336396 31371 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:41.336563 31371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:41.336912 31371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:41.340366 31371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "8d3d9c66314e405591f515f3136d730c"
format_stamp: "Formatted at 2026-06-19 04:44:41 on dist-test-slave-9dgf"
server_key: "9ecf7d17b1a352a14bc90c07abdef4fe"
server_key_iv: "31d0ffd7641c917b43b9189afc34c14e"
server_key_version: "encryptionkey@0"
I20260619 04:44:41.341261 31371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "8d3d9c66314e405591f515f3136d730c"
format_stamp: "Formatted at 2026-06-19 04:44:41 on dist-test-slave-9dgf"
server_key: "9ecf7d17b1a352a14bc90c07abdef4fe"
server_key_iv: "31d0ffd7641c917b43b9189afc34c14e"
server_key_version: "encryptionkey@0"
I20260619 04:44:41.347465 31371 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260619 04:44:41.351384 31386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:41.353027 31371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 04:44:41.353248 31371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "8d3d9c66314e405591f515f3136d730c"
format_stamp: "Formatted at 2026-06-19 04:44:41 on dist-test-slave-9dgf"
server_key: "9ecf7d17b1a352a14bc90c07abdef4fe"
server_key_iv: "31d0ffd7641c917b43b9189afc34c14e"
server_key_version: "encryptionkey@0"
I20260619 04:44:41.353484 31371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:41.359694 31371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:41.364269 31371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:41.364590 31371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:41.383702 31371 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40771
I20260619 04:44:41.383720 31437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40771 every 8 connection(s)
I20260619 04:44:41.385211 31371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:41.389153 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31371
I20260619 04:44:41.389186 31438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:41.389333 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:41.389782 10113 external_mini_cluster.cc:1428] Setting key b4e5573d9b89788b61e3262d81f4ded4
I20260619 04:44:41.397828 31441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:41.391646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:58441 (local address 127.0.0.1:40771)
0619 04:44:41.392560 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:41.392573 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:41.392615 (+ 42us) server_negotiation.cc:407] Connection header received
0619 04:44:41.394150 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:41.394174 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:41.394611 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:41.394991 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:41.396135 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:41.396142 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:41.396159 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:41.396175 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:41.396243 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:41.396264 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:41.396469 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:41.396585 (+ 116us) server_negotiation.cc:299] Negotiation successful
0619 04:44:41.396850 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":396,"threads_started":1}
I20260619 04:44:41.401743 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:41.403275 31438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c: Bootstrap starting.
I20260619 04:44:41.407713 31438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:41.408921 31438 log.cc:824] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:41.410111 31441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:41.407360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:44695 (local address 127.0.0.1:40771)
0619 04:44:41.407572 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:41.407579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:41.407950 (+ 371us) server_negotiation.cc:407] Connection header received
0619 04:44:41.408180 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:41.408184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:41.408237 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:41.408351 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:41.409385 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:41.409390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:41.409395 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:41.409427 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:41.409472 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:41.409489 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:41.409620 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:41.409743 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 04:44:41.409812 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:44:41.412199 31438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c: No bootstrap required, opened a new log
I20260619 04:44:41.419724 31438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3d9c66314e405591f515f3136d730c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40771 } }
I20260619 04:44:41.420168 31438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:41.420287 31438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3d9c66314e405591f515f3136d730c, State: Initialized, Role: FOLLOWER
I20260619 04:44:41.420887 31438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3d9c66314e405591f515f3136d730c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40771 } }
I20260619 04:44:41.421100 31438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:41.421206 31438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:41.421329 31438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:41.423671 31438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3d9c66314e405591f515f3136d730c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40771 } }
I20260619 04:44:41.424160 31438 leader_election.cc:302] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d3d9c66314e405591f515f3136d730c; no voters:
I20260619 04:44:41.424718 31438 leader_election.cc:288] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:41.424860 31448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:41.426066 31448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [term 1 LEADER]: Becoming Leader. State: Replica: 8d3d9c66314e405591f515f3136d730c, State: Running, Role: LEADER
I20260619 04:44:41.426611 31448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3d9c66314e405591f515f3136d730c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40771 } }
I20260619 04:44:41.427202 31438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:41.430914 31449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d3d9c66314e405591f515f3136d730c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3d9c66314e405591f515f3136d730c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40771 } } }
I20260619 04:44:41.431362 31449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:41.431584 31450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d3d9c66314e405591f515f3136d730c. Latest consensus state: current_term: 1 leader_uuid: "8d3d9c66314e405591f515f3136d730c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3d9c66314e405591f515f3136d730c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40771 } } }
I20260619 04:44:41.431898 31450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:41.435688 31458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:41.440402 31458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:41.449060 31458 catalog_manager.cc:1347] Generated new cluster ID: ae9f3f52eadc43ae9f8be56f9a2d1b3d
I20260619 04:44:41.449196 31458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:41.461229 31458 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:41.461777 31458 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:41.469542 31458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d3d9c66314e405591f515f3136d730c: Generated new TSK 0
I20260619 04:44:41.470667 31458 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:41.482260 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31371
W20260619 04:44:41.483537 31433 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.206:58441
W20260619 04:44:41.484326 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31371: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:41.484495 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31371
2026-06-19T04:44:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1911 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:41 dist-test-slave-9dgf krb5kdc[31469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:41 dist-test-slave-9dgf krb5kdc[31469](info): set up 2 sockets
Jun 19 04:44:41 dist-test-slave-9dgf krb5kdc[31469](info): commencing operation
krb5kdc: starting...
W20260619 04:44:42.618871 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.010s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:42 dist-test-slave-9dgf krb5kdc[31469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:42.893757 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:43.230901 31482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:43.231274 31482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:43.231448 31482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:43.238739 31482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:43.238904 31482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:43.239029 31482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:43.239141 31482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:43.239212 31482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:43.249272 31482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:43.250675 31482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:43.251983 31482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:43.264110 31487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:43.264099 31488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:43.264775 31490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:43.265106 31482 server_base.cc:1034] running on GCE node
I20260619 04:44:43.265971 31482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:43.267545 31482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:43.268767 31482 hybrid_clock.cc:648] HybridClock initialized: now 1781844283268703 us; error 59 us; skew 500 ppm
I20260619 04:44:43.269176 31482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:43 dist-test-slave-9dgf krb5kdc[31469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844283, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:43.272598 31482 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:43.274192 31482 webserver.cc:460] Webserver started at http://127.0.0.1:36443/ using document root <none> and password file <none>
I20260619 04:44:43.274932 31482 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:43.275038 31482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:43.275285 31482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:43.278347 31482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "d92862ab88fe4a62acf428fa2bc4af95"
format_stamp: "Formatted at 2026-06-19 04:44:43 on dist-test-slave-9dgf"
server_key: "d5a77531599085b6ee7b63cd61b0d60f"
server_key_iv: "7c2a7ec1ab4693ca50911a1d790ed3d4"
server_key_version: "encryptionkey@0"
I20260619 04:44:43.279234 31482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "d92862ab88fe4a62acf428fa2bc4af95"
format_stamp: "Formatted at 2026-06-19 04:44:43 on dist-test-slave-9dgf"
server_key: "d5a77531599085b6ee7b63cd61b0d60f"
server_key_iv: "7c2a7ec1ab4693ca50911a1d790ed3d4"
server_key_version: "encryptionkey@0"
I20260619 04:44:43.284678 31482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:43.288425 31497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:43.289943 31482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 04:44:43.290149 31482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "d92862ab88fe4a62acf428fa2bc4af95"
format_stamp: "Formatted at 2026-06-19 04:44:43 on dist-test-slave-9dgf"
server_key: "d5a77531599085b6ee7b63cd61b0d60f"
server_key_iv: "7c2a7ec1ab4693ca50911a1d790ed3d4"
server_key_version: "encryptionkey@0"
I20260619 04:44:43.290419 31482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:43.314620 31482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:43.319027 31482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:43.319380 31482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:43.338555 31482 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33837
I20260619 04:44:43.338595 31548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33837 every 8 connection(s)
I20260619 04:44:43.340046 31482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:43.344046 31549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:43.350287 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31482
I20260619 04:44:43.350482 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:43.350932 10113 external_mini_cluster.cc:1428] Setting key ff8d5f1b73baaf9cc45149e74b9afc25
I20260619 04:44:43.355541 31549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95: Bootstrap starting.
I20260619 04:44:43.359505 31549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:43.360821 31549 log.cc:824] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:43.363848 31549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95: No bootstrap required, opened a new log
Jun 19 04:44:43 dist-test-slave-9dgf krb5kdc[31469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 04:44:43.372448 31549 raft_consensus.cc:348] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92862ab88fe4a62acf428fa2bc4af95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33837 } }
I20260619 04:44:43.372860 31549 raft_consensus.cc:374] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:43.372994 31549 raft_consensus.cc:729] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d92862ab88fe4a62acf428fa2bc4af95, State: Initialized, Role: FOLLOWER
I20260619 04:44:43.373692 31549 consensus_queue.cc:260] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92862ab88fe4a62acf428fa2bc4af95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33837 } }
I20260619 04:44:43.373950 31549 raft_consensus.cc:388] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:43.374114 31549 raft_consensus.cc:482] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:43.374396 31549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:43.375545 31552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:43.352974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:54473 (local address 127.0.0.1:33837)
0619 04:44:43.353825 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:43.353837 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:43.353880 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:44:43.355672 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:43.355707 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:43.356134 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:43.356459 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:43.358451 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:43.359874 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:43.361732 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:43.362511 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:43.362702 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:43.367296 (+ 4594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:43.367305 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:43.367320 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:43.367360 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:43.370914 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:43.371809 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:43.371816 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:43.371823 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:43.371998 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:43.372496 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:43.372500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:43.372502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:43.373183 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:43.373548 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:43.374043 (+ 495us) server_negotiation.cc:299] Negotiation successful
0619 04:44:43.374429 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":404,"threads_started":1}
I20260619 04:44:43.377120 31549 raft_consensus.cc:504] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92862ab88fe4a62acf428fa2bc4af95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33837 } }
I20260619 04:44:43.377720 31549 leader_election.cc:302] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d92862ab88fe4a62acf428fa2bc4af95; no voters:
I20260619 04:44:43.378472 31549 leader_election.cc:288] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:43.378607 31554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:43.380177 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:43.380132 31554 raft_consensus.cc:686] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [term 1 LEADER]: Becoming Leader. State: Replica: d92862ab88fe4a62acf428fa2bc4af95, State: Running, Role: LEADER
I20260619 04:44:43.380712 31554 consensus_queue.cc:237] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92862ab88fe4a62acf428fa2bc4af95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33837 } }
I20260619 04:44:43.380822 31549 sys_catalog.cc:564] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:43.383323 31555 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d92862ab88fe4a62acf428fa2bc4af95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92862ab88fe4a62acf428fa2bc4af95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33837 } } }
I20260619 04:44:43.383785 31555 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:43.384505 31556 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d92862ab88fe4a62acf428fa2bc4af95. Latest consensus state: current_term: 1 leader_uuid: "d92862ab88fe4a62acf428fa2bc4af95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92862ab88fe4a62acf428fa2bc4af95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33837 } } }
I20260619 04:44:43.384855 31556 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:43.388763 31560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:43.394892 31560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:43.418701 31552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:43.392763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:51313 (local address 127.0.0.1:33837)
0619 04:44:43.393021 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:43.393030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:43.395107 (+ 2077us) server_negotiation.cc:407] Connection header received
0619 04:44:43.395476 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:43.395488 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:43.395675 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:43.395874 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:43.398578 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:43.400242 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:43.402854 (+ 2612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:43.403848 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:43.403980 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:43.408606 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:43.408617 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:43.408625 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:43.408686 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:43.413588 (+ 4902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:43.415110 (+ 1522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:43.415119 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:43.415125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:43.415316 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:43.416039 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:43.416062 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:43.416069 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:43.416613 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:43.416936 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:43.417831 (+ 895us) server_negotiation.cc:299] Negotiation successful
0619 04:44:43.418104 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:44:43.425037 31560 catalog_manager.cc:1347] Generated new cluster ID: 7ed896d428b4462dbc35cb66a9f4f86a
I20260619 04:44:43.425163 31560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:43.446775 31560 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:43.448127 31560 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:43.454371 31560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d92862ab88fe4a62acf428fa2bc4af95: Generated new TSK 0
I20260619 04:44:43.455261 31560 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:43.461768 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31482
I20260619 04:44:43.462990 31544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:43.555147 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31482
W20260619 04:44:43.572751 31467 connection.cc:535] client connection to 127.0.0.1:33837 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33837): Connection reset by peer (error 104)
2026-06-19T04:44:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:43 dist-test-slave-9dgf krb5kdc[31581](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:43 dist-test-slave-9dgf krb5kdc[31581](info): set up 2 sockets
Jun 19 04:44:43 dist-test-slave-9dgf krb5kdc[31581](info): commencing operation
krb5kdc: starting...
W20260619 04:44:44.674860 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.005s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:44 dist-test-slave-9dgf krb5kdc[31581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:44.949509 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41689
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:45.289713 31594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:45.290071 31594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:45.290251 31594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:45.297479 31594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:45.297636 31594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:45.297751 31594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:45.297859 31594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:45.297946 31594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:45.308108 31594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41689
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:45.309561 31594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:45.310976 31594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:45.323355 31599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:45.323287 31602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:45.323320 31600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:45.324254 31594 server_base.cc:1034] running on GCE node
I20260619 04:44:45.325105 31594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:45.326686 31594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:45.327929 31594 hybrid_clock.cc:648] HybridClock initialized: now 1781844285327873 us; error 37 us; skew 500 ppm
I20260619 04:44:45.328313 31594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:45 dist-test-slave-9dgf krb5kdc[31581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844285, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:45.331571 31594 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:45.333043 31594 webserver.cc:460] Webserver started at http://127.0.0.1:34769/ using document root <none> and password file <none>
I20260619 04:44:45.333750 31594 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:45.333896 31594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:45.334342 31594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:45.337356 31594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "d6764311f760400faf3424021d7e3fef"
format_stamp: "Formatted at 2026-06-19 04:44:45 on dist-test-slave-9dgf"
server_key: "67c7e7fd05cdbd368bc8164ee0577b43"
server_key_iv: "ada0aa7eee583ac78dc3f00c6c8e5750"
server_key_version: "encryptionkey@0"
I20260619 04:44:45.338157 31594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "d6764311f760400faf3424021d7e3fef"
format_stamp: "Formatted at 2026-06-19 04:44:45 on dist-test-slave-9dgf"
server_key: "67c7e7fd05cdbd368bc8164ee0577b43"
server_key_iv: "ada0aa7eee583ac78dc3f00c6c8e5750"
server_key_version: "encryptionkey@0"
I20260619 04:44:45.343603 31594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260619 04:44:45.347473 31609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:45.348829 31594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:45.349062 31594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "d6764311f760400faf3424021d7e3fef"
format_stamp: "Formatted at 2026-06-19 04:44:45 on dist-test-slave-9dgf"
server_key: "67c7e7fd05cdbd368bc8164ee0577b43"
server_key_iv: "ada0aa7eee583ac78dc3f00c6c8e5750"
server_key_version: "encryptionkey@0"
I20260619 04:44:45.349272 31594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:45.367653 31594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:45.372063 31594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:45.372367 31594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:45.391215 31594 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41689
I20260619 04:44:45.391239 31660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41689 every 8 connection(s)
I20260619 04:44:45.392633 31594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:45.395447 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31594
I20260619 04:44:45.395634 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:45.396108 10113 external_mini_cluster.cc:1428] Setting key 4dedcdd72fe7971ca1e23c64ca7d5169
I20260619 04:44:45.396694 31661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:45.412263 31661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef: Bootstrap starting.
I20260619 04:44:45.412284 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:45.398036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:39271 (local address 127.0.0.1:41689)
0619 04:44:45.398871 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:45.398887 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:45.398938 (+ 51us) server_negotiation.cc:407] Connection header received
0619 04:44:45.401492 (+ 2554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:45.401522 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:45.402104 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:45.402582 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:45.403133 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:45.405165 (+ 2032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:45.406675 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:45.407752 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:45.407952 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:45.409318 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:45.409329 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:45.409348 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:45.410138 (+ 790us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:45.410255 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:45.410290 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:45.410444 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:45.410754 (+ 310us) server_negotiation.cc:299] Negotiation successful
0619 04:44:45.410933 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":353,"threads_started":1}
I20260619 04:44:45.415771 31661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:45.416404 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:45.416952 31661 log.cc:824] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:45.420017 31661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef: No bootstrap required, opened a new log
I20260619 04:44:45.428532 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:45.421261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:56827 (local address 127.0.0.1:41689)
0619 04:44:45.421471 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:45.421480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:45.421962 (+ 482us) server_negotiation.cc:407] Connection header received
0619 04:44:45.422114 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:45.422118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:45.422180 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:45.422325 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:45.422954 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:45.423752 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:45.425640 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:45.426198 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:45.426364 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:45.427666 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:45.427671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:45.427674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:45.427692 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:45.427735 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:45.427751 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:45.427853 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:45.428093 (+ 240us) server_negotiation.cc:299] Negotiation successful
0619 04:44:45.428191 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:44:45.430090 31661 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6764311f760400faf3424021d7e3fef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41689 } }
I20260619 04:44:45.430569 31661 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:45.430676 31661 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6764311f760400faf3424021d7e3fef, State: Initialized, Role: FOLLOWER
I20260619 04:44:45.431273 31661 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6764311f760400faf3424021d7e3fef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41689 } }
I20260619 04:44:45.431517 31661 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:45.431660 31661 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:45.431834 31661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:45.434142 31661 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6764311f760400faf3424021d7e3fef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41689 } }
I20260619 04:44:45.434695 31661 leader_election.cc:302] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6764311f760400faf3424021d7e3fef; no voters:
I20260619 04:44:45.435210 31661 leader_election.cc:288] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:45.435367 31671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:45.436131 31671 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [term 1 LEADER]: Becoming Leader. State: Replica: d6764311f760400faf3424021d7e3fef, State: Running, Role: LEADER
I20260619 04:44:45.436755 31671 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6764311f760400faf3424021d7e3fef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41689 } }
I20260619 04:44:45.437487 31661 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:45.439556 31672 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6764311f760400faf3424021d7e3fef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6764311f760400faf3424021d7e3fef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41689 } } }
I20260619 04:44:45.439898 31672 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:45.440791 31676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:45.440654 31673 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6764311f760400faf3424021d7e3fef. Latest consensus state: current_term: 1 leader_uuid: "d6764311f760400faf3424021d7e3fef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6764311f760400faf3424021d7e3fef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41689 } } }
I20260619 04:44:45.441958 31673 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:45.446875 31676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:45.456585 31676 catalog_manager.cc:1347] Generated new cluster ID: c58c5676d32d4d8f99b5f6e8c93f5915
I20260619 04:44:45.456751 31676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:45.481052 31676 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:45.482573 31676 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:45.494163 31676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6764311f760400faf3424021d7e3fef: Generated new TSK 0
I20260619 04:44:45.495093 31676 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:45.502051 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31594
W20260619 04:44:45.503252 31656 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.206:39271
W20260619 04:44:45.504160 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31594: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:45.504333 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31594
W20260619 04:44:45.521701 31579 connection.cc:535] client connection to 127.0.0.1:41689 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41689): Connection reset by peer (error 104)
2026-06-19T04:44:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1948 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:45 dist-test-slave-9dgf krb5kdc[31692](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:45 dist-test-slave-9dgf krb5kdc[31692](info): set up 2 sockets
Jun 19 04:44:45 dist-test-slave-9dgf krb5kdc[31692](info): commencing operation
krb5kdc: starting...
W20260619 04:44:46.618870 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.003s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:46 dist-test-slave-9dgf krb5kdc[31692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 04:44:46.884143 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36743
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:47.217836 31705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:47.218269 31705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:47.218472 31705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:47.226514 31705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:47.226679 31705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:47.226764 31705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:47.226857 31705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:47.226925 31705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:47.237249 31705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36743
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:47.238692 31705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:47.240031 31705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:47.252218 31710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:47.252247 31711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:47.252556 31713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:47.253351 31705 server_base.cc:1034] running on GCE node
I20260619 04:44:47.254285 31705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:47.255851 31705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:47.257095 31705 hybrid_clock.cc:648] HybridClock initialized: now 1781844287257055 us; error 47 us; skew 500 ppm
I20260619 04:44:47.257473 31705 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:47 dist-test-slave-9dgf krb5kdc[31692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844287, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:47.264886 31705 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 04:44:47.266739 31705 webserver.cc:460] Webserver started at http://127.0.0.1:38885/ using document root <none> and password file <none>
I20260619 04:44:47.267494 31705 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:47.267649 31705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:47.267972 31705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:47.271210 31705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "e1238499bcbe411a909b8ac606fba8f9"
format_stamp: "Formatted at 2026-06-19 04:44:47 on dist-test-slave-9dgf"
server_key: "d9a6d911b30c58a2ed82f16b2087bc77"
server_key_iv: "d0a8206887ae828c12e301284eebd4fa"
server_key_version: "encryptionkey@0"
I20260619 04:44:47.272015 31705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "e1238499bcbe411a909b8ac606fba8f9"
format_stamp: "Formatted at 2026-06-19 04:44:47 on dist-test-slave-9dgf"
server_key: "d9a6d911b30c58a2ed82f16b2087bc77"
server_key_iv: "d0a8206887ae828c12e301284eebd4fa"
server_key_version: "encryptionkey@0"
I20260619 04:44:47.277611 31705 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:44:47.281508 31720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:47.283082 31705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:47.283301 31705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "e1238499bcbe411a909b8ac606fba8f9"
format_stamp: "Formatted at 2026-06-19 04:44:47 on dist-test-slave-9dgf"
server_key: "d9a6d911b30c58a2ed82f16b2087bc77"
server_key_iv: "d0a8206887ae828c12e301284eebd4fa"
server_key_version: "encryptionkey@0"
I20260619 04:44:47.283524 31705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:47.289702 31705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:47.294014 31705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:47.294405 31705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:47.313874 31705 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36743
I20260619 04:44:47.313975 31771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36743 every 8 connection(s)
I20260619 04:44:47.315424 31705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:47.319800 31772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:47.320479 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31705
I20260619 04:44:47.320675 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:47.321230 10113 external_mini_cluster.cc:1428] Setting key f38cf33b99267288c7a8db410aad965d
I20260619 04:44:47.329779 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:47.323163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:43741 (local address 127.0.0.1:36743)
0619 04:44:47.324027 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:47.324039 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:47.324082 (+ 43us) server_negotiation.cc:407] Connection header received
0619 04:44:47.326371 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:47.326399 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:47.326776 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:47.327150 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:47.328194 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:47.328201 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:47.328215 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:47.328229 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:47.328286 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:47.328308 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:47.328471 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:47.328597 (+ 126us) server_negotiation.cc:299] Negotiation successful
0619 04:44:47.328814 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":423,"threads_started":1}
I20260619 04:44:47.333293 31772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9: Bootstrap starting.
I20260619 04:44:47.333500 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:47.337167 31772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:47.338589 31772 log.cc:824] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:47.341418 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:47.338918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.206:40455 (local address 127.0.0.1:36743)
0619 04:44:47.339118 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:47.339135 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:47.339397 (+ 262us) server_negotiation.cc:407] Connection header received
0619 04:44:47.339594 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:47.339599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:47.339662 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:47.339775 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:47.340763 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:47.340768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:47.340777 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:47.340795 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:47.340840 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:47.340855 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:47.340972 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:47.341084 (+ 112us) server_negotiation.cc:299] Negotiation successful
0619 04:44:47.341148 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 04:44:47.341837 31772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9: No bootstrap required, opened a new log
I20260619 04:44:47.350108 31772 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1238499bcbe411a909b8ac606fba8f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36743 } }
I20260619 04:44:47.350704 31772 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:47.350806 31772 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1238499bcbe411a909b8ac606fba8f9, State: Initialized, Role: FOLLOWER
I20260619 04:44:47.351320 31772 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1238499bcbe411a909b8ac606fba8f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36743 } }
I20260619 04:44:47.351521 31772 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:47.351616 31772 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:47.351742 31772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:47.353874 31772 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1238499bcbe411a909b8ac606fba8f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36743 } }
I20260619 04:44:47.354408 31772 leader_election.cc:302] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1238499bcbe411a909b8ac606fba8f9; no voters:
I20260619 04:44:47.354971 31772 leader_election.cc:288] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:47.355127 31782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:47.355823 31782 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [term 1 LEADER]: Becoming Leader. State: Replica: e1238499bcbe411a909b8ac606fba8f9, State: Running, Role: LEADER
I20260619 04:44:47.356545 31782 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1238499bcbe411a909b8ac606fba8f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36743 } }
I20260619 04:44:47.357332 31772 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:47.359880 31784 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1238499bcbe411a909b8ac606fba8f9. Latest consensus state: current_term: 1 leader_uuid: "e1238499bcbe411a909b8ac606fba8f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1238499bcbe411a909b8ac606fba8f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36743 } } }
I20260619 04:44:47.359733 31783 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1238499bcbe411a909b8ac606fba8f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1238499bcbe411a909b8ac606fba8f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36743 } } }
I20260619 04:44:47.360285 31784 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:47.360330 31783 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:47.363551 31791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:47.369495 31791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:47.378862 31791 catalog_manager.cc:1347] Generated new cluster ID: 71c744b1901743138deccfe820cadb6e
I20260619 04:44:47.379113 31791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:47.393831 31791 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:47.394387 31791 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:47.402463 31791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1238499bcbe411a909b8ac606fba8f9: Generated new TSK 0
I20260619 04:44:47.403359 31791 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:47.414050 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31705
W20260619 04:44:47.415999 31767 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.206:43741
W20260619 04:44:47.416729 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31705: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:47.416894 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31705
2026-06-19T04:44:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1912 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:47 dist-test-slave-9dgf krb5kdc[31803](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:47 dist-test-slave-9dgf krb5kdc[31803](info): set up 2 sockets
Jun 19 04:44:47 dist-test-slave-9dgf krb5kdc[31803](info): commencing operation
krb5kdc: starting...
W20260619 04:44:48.534893 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:48 dist-test-slave-9dgf krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:48.801223 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38421
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:38421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:49.138916 31816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:49.139269 31816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:49.139437 31816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:49.146891 31816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:49.147047 31816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:49.147156 31816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:49.147261 31816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:49.147339 31816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:49.157519 31816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:38421
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:38421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:49.159257 31816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:49.160511 31816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:49.172726 31821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:49.172652 31824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:49.172662 31822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:49.173682 31816 server_base.cc:1034] running on GCE node
I20260619 04:44:49.174584 31816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:49.176153 31816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:49.177392 31816 hybrid_clock.cc:648] HybridClock initialized: now 1781844289177342 us; error 43 us; skew 500 ppm
I20260619 04:44:49.177785 31816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:49 dist-test-slave-9dgf krb5kdc[31803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844289, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:49.181124 31816 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:49.182793 31816 webserver.cc:460] Webserver started at http://127.9.224.126:34207/ using document root <none> and password file <none>
I20260619 04:44:49.183521 31816 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:49.183671 31816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:49.183990 31816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:49.187379 31816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "1235614148184066a33805981aad26f7"
format_stamp: "Formatted at 2026-06-19 04:44:49 on dist-test-slave-9dgf"
server_key: "4df45b3d8c5473f9bb5365ced01ce645"
server_key_iv: "641ba208834de1f8d2ad3ebbf4657868"
server_key_version: "encryptionkey@0"
I20260619 04:44:49.188248 31816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "1235614148184066a33805981aad26f7"
format_stamp: "Formatted at 2026-06-19 04:44:49 on dist-test-slave-9dgf"
server_key: "4df45b3d8c5473f9bb5365ced01ce645"
server_key_iv: "641ba208834de1f8d2ad3ebbf4657868"
server_key_version: "encryptionkey@0"
I20260619 04:44:49.193766 31816 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:44:49.197659 31831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:49.199160 31816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 04:44:49.199354 31816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "1235614148184066a33805981aad26f7"
format_stamp: "Formatted at 2026-06-19 04:44:49 on dist-test-slave-9dgf"
server_key: "4df45b3d8c5473f9bb5365ced01ce645"
server_key_iv: "641ba208834de1f8d2ad3ebbf4657868"
server_key_version: "encryptionkey@0"
I20260619 04:44:49.199559 31816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:49.216909 31816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:49.221442 31816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:49.221745 31816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:49.240913 31816 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:38421
I20260619 04:44:49.240933 31882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:38421 every 8 connection(s)
I20260619 04:44:49.242420 31816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:49.246349 31883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:49.247026 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31816
I20260619 04:44:49.247217 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:49.247661 10113 external_mini_cluster.cc:1428] Setting key 67de7117a67e59d391794fe4fa36cc6f
I20260619 04:44:49.261052 31883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7: Bootstrap starting.
Jun 19 04:44:49 dist-test-slave-9dgf krb5kdc[31803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:49.264734 31883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:49.266192 31883 log.cc:824] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:49.269672 31883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7: No bootstrap required, opened a new log
I20260619 04:44:49.273694 31886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:49.249504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47853 (local address 127.9.224.126:38421)
0619 04:44:49.250355 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:49.250369 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:49.250421 (+ 52us) server_negotiation.cc:407] Connection header received
0619 04:44:49.253052 (+ 2631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:49.253082 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:49.253638 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:49.254101 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:49.255506 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:49.257538 (+ 2032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:49.259003 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:49.260077 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:49.260277 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:49.264735 (+ 4458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:49.264748 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:49.264771 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:49.264829 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:49.268748 (+ 3919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:49.269610 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:49.269619 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:49.269628 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:49.269857 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:49.270341 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:49.270348 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:49.270351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:49.271147 (+ 796us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:49.271504 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:49.271861 (+ 357us) server_negotiation.cc:299] Negotiation successful
0619 04:44:49.272223 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":315,"threads_started":1}
I20260619 04:44:49.277817 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:49.279764 31883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1235614148184066a33805981aad26f7" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38421 } }
I20260619 04:44:49.280189 31883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:49.280297 31883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1235614148184066a33805981aad26f7, State: Initialized, Role: FOLLOWER
I20260619 04:44:49.280992 31883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1235614148184066a33805981aad26f7" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38421 } }
I20260619 04:44:49.281307 31883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:49.281457 31883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:49.281643 31883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:49.285213 31883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1235614148184066a33805981aad26f7" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38421 } }
I20260619 04:44:49.285774 31883 leader_election.cc:302] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1235614148184066a33805981aad26f7; no voters:
I20260619 04:44:49.286543 31883 leader_election.cc:288] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:49.286659 31893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:49.288854 31883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:49.293561 31893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [term 1 LEADER]: Becoming Leader. State: Replica: 1235614148184066a33805981aad26f7, State: Running, Role: LEADER
I20260619 04:44:49.294241 31893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1235614148184066a33805981aad26f7" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38421 } }
I20260619 04:44:49.297386 31894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1235614148184066a33805981aad26f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1235614148184066a33805981aad26f7" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38421 } } }
I20260619 04:44:49.297436 31895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1235614148184066a33805981aad26f7. Latest consensus state: current_term: 1 leader_uuid: "1235614148184066a33805981aad26f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1235614148184066a33805981aad26f7" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 38421 } } }
I20260619 04:44:49.297843 31895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:49.297843 31894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:49.302175 31886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:49.282050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55285 (local address 127.9.224.126:38421)
0619 04:44:49.282284 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:49.282293 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:49.282813 (+ 520us) server_negotiation.cc:407] Connection header received
0619 04:44:49.282983 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:49.282986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:49.283048 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:49.283131 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:49.285035 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:49.285801 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:49.287768 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:49.288482 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:49.288591 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:49.292570 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:49.292580 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:49.292588 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:49.292650 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:49.296924 (+ 4274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:49.298212 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:49.298220 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:49.298263 (+ 43us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:49.298457 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:49.299178 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:49.299186 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:49.299192 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:49.299744 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:49.300066 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:49.301472 (+ 1406us) server_negotiation.cc:299] Negotiation successful
0619 04:44:49.301682 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:44:49.306365 31901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:49.311733 31901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:49.322554 31901 catalog_manager.cc:1347] Generated new cluster ID: 7803498e1ae747939aaa5f0944c26537
I20260619 04:44:49.322702 31901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:49.345603 31901 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:49.347548 31901 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:49.366178 31901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1235614148184066a33805981aad26f7: Generated new TSK 0
I20260619 04:44:49.367165 31901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:49.374979 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31816
I20260619 04:44:49.376415 31878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:49.470993 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31816
W20260619 04:44:49.488515 31801 connection.cc:535] client connection to 127.9.224.126:38421 recv error: Network error: failed to read from TLS socket (remote: 127.9.224.126:38421): Connection reset by peer (error 104)
2026-06-19T04:44:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2054 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:49 dist-test-slave-9dgf krb5kdc[31915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:49 dist-test-slave-9dgf krb5kdc[31915](info): set up 2 sockets
Jun 19 04:44:49 dist-test-slave-9dgf krb5kdc[31915](info): commencing operation
krb5kdc: starting...
W20260619 04:44:50.582809 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:50 dist-test-slave-9dgf krb5kdc[31915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:50.849885 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34845
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:45451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:34845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:51.185598 31928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:51.185962 31928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:51.186136 31928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:51.193626 31928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:51.193799 31928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:51.193907 31928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:51.194023 31928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:51.194103 31928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:51.204530 31928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:45451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:34845
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:34845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:51.205899 31928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:51.207264 31928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:51.219172 31933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:51.219256 31934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:51.219276 31936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:51.220523 31928 server_base.cc:1034] running on GCE node
I20260619 04:44:51.221233 31928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:51.222687 31928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:51.223920 31928 hybrid_clock.cc:648] HybridClock initialized: now 1781844291223880 us; error 36 us; skew 500 ppm
I20260619 04:44:51.224277 31928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:51 dist-test-slave-9dgf krb5kdc[31915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844291, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:51.227458 31928 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:51.229000 31928 webserver.cc:460] Webserver started at http://127.9.224.126:33927/ using document root <none> and password file <none>
I20260619 04:44:51.229723 31928 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:51.229873 31928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:51.230192 31928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:51.233296 31928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "5d252d2d67714bc8bb4e945582f30130"
format_stamp: "Formatted at 2026-06-19 04:44:51 on dist-test-slave-9dgf"
server_key: "9cccd572b463f435979aa957d37c92a8"
server_key_iv: "1c66ba67f2ca6f260ae342dcde6a3ac6"
server_key_version: "encryptionkey@0"
I20260619 04:44:51.234180 31928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "5d252d2d67714bc8bb4e945582f30130"
format_stamp: "Formatted at 2026-06-19 04:44:51 on dist-test-slave-9dgf"
server_key: "9cccd572b463f435979aa957d37c92a8"
server_key_iv: "1c66ba67f2ca6f260ae342dcde6a3ac6"
server_key_version: "encryptionkey@0"
I20260619 04:44:51.239491 31928 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 04:44:51.243041 31943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:51.244505 31928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:51.244692 31928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "5d252d2d67714bc8bb4e945582f30130"
format_stamp: "Formatted at 2026-06-19 04:44:51 on dist-test-slave-9dgf"
server_key: "9cccd572b463f435979aa957d37c92a8"
server_key_iv: "1c66ba67f2ca6f260ae342dcde6a3ac6"
server_key_version: "encryptionkey@0"
I20260619 04:44:51.244903 31928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:51.260463 31928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:51.264770 31928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:51.265075 31928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:51.284288 31928 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:34845
I20260619 04:44:51.284315 31994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:34845 every 8 connection(s)
I20260619 04:44:51.285749 31928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:51.289654 31995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:51.294986 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 31928
I20260619 04:44:51.295153 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:51.295686 10113 external_mini_cluster.cc:1428] Setting key b6e6ff589e49de1fbdb0837df956b882
I20260619 04:44:51.301225 31995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130: Bootstrap starting.
I20260619 04:44:51.304445 31995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:51.305533 31995 log.cc:824] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:51.309032 31995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130: No bootstrap required, opened a new log
I20260619 04:44:51.309546 31998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:51.297662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46981 (local address 127.9.224.126:34845)
0619 04:44:51.298630 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:51.298642 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:51.298701 (+ 59us) server_negotiation.cc:407] Connection header received
0619 04:44:51.300451 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:51.300481 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:51.300894 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:51.301304 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:51.301867 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:51.303277 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:51.304572 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:51.305279 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:51.305489 (+ 210us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:51.306918 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:51.306951 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:51.306970 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:51.307678 (+ 708us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:51.307778 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:51.307809 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:51.307997 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:51.308322 (+ 325us) server_negotiation.cc:299] Negotiation successful
0619 04:44:51.308506 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":431,"threads_started":1}
I20260619 04:44:51.314093 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:51.317639 31995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d252d2d67714bc8bb4e945582f30130" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34845 } }
I20260619 04:44:51.318085 31995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:51.318197 31995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d252d2d67714bc8bb4e945582f30130, State: Initialized, Role: FOLLOWER
I20260619 04:44:51.318989 31995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d252d2d67714bc8bb4e945582f30130" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34845 } }
I20260619 04:44:51.319283 31995 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:51.319448 31995 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:51.319645 31995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:51.322856 31995 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d252d2d67714bc8bb4e945582f30130" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34845 } }
I20260619 04:44:51.323493 31995 leader_election.cc:302] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d252d2d67714bc8bb4e945582f30130; no voters:
I20260619 04:44:51.324234 31995 leader_election.cc:288] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:51.324394 32005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:51.325222 32005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [term 1 LEADER]: Becoming Leader. State: Replica: 5d252d2d67714bc8bb4e945582f30130, State: Running, Role: LEADER
I20260619 04:44:51.325981 32005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d252d2d67714bc8bb4e945582f30130" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34845 } }
I20260619 04:44:51.326759 31998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:51.318813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58085 (local address 127.9.224.126:34845)
0619 04:44:51.319031 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:51.319038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:51.319553 (+ 515us) server_negotiation.cc:407] Connection header received
0619 04:44:51.319786 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:51.319792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:51.319886 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:51.320015 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:51.320571 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:51.321742 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:51.323397 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:51.324116 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:51.324285 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:51.325642 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:51.325649 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:51.325653 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:51.325675 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:51.325753 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:51.325775 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:51.325901 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:51.326387 (+ 486us) server_negotiation.cc:299] Negotiation successful
0619 04:44:51.326447 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:44:51.326859 31995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:51.328927 32006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d252d2d67714bc8bb4e945582f30130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d252d2d67714bc8bb4e945582f30130" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34845 } } }
I20260619 04:44:51.329252 32006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:51.330108 32010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:51.329962 32007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d252d2d67714bc8bb4e945582f30130. Latest consensus state: current_term: 1 leader_uuid: "5d252d2d67714bc8bb4e945582f30130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d252d2d67714bc8bb4e945582f30130" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 34845 } } }
I20260619 04:44:51.331178 32007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130 [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:51.336289 32010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:51.346174 32010 catalog_manager.cc:1347] Generated new cluster ID: 7c45ca04baf848178a8ce7f1454c19aa
I20260619 04:44:51.346321 32010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:51.363494 32010 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:51.365371 32010 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:51.382685 32010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d252d2d67714bc8bb4e945582f30130: Generated new TSK 0
I20260619 04:44:51.383823 32010 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:51.390391 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31928
W20260619 04:44:51.391782 31990 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46981
W20260619 04:44:51.392582 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 31928: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:51.392758 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 31928
W20260619 04:44:51.409793 31913 connection.cc:535] client connection to 127.9.224.126:34845 recv error: Network error: failed to read from TLS socket (remote: 127.9.224.126:34845): Connection reset by peer (error 104)
2026-06-19T04:44:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1921 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:51 dist-test-slave-9dgf krb5kdc[32026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:51 dist-test-slave-9dgf krb5kdc[32026](info): set up 2 sockets
Jun 19 04:44:51 dist-test-slave-9dgf krb5kdc[32026](info): commencing operation
krb5kdc: starting...
W20260619 04:44:52.526775 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.005s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:52 dist-test-slave-9dgf krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:52.799214 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:33629
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:33629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:53.134145 32039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:53.134452 32039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:53.134619 32039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:53.141987 32039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:53.142109 32039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:53.142244 32039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:53.142359 32039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:53.142436 32039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:53.152491 32039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:33629
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:33629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:53.153893 32039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:53.155294 32039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:53.167537 32044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:53.167500 32045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:53.167465 32047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:53.168679 32039 server_base.cc:1034] running on GCE node
I20260619 04:44:53.169577 32039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:53.171195 32039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:53.172432 32039 hybrid_clock.cc:648] HybridClock initialized: now 1781844293172386 us; error 33 us; skew 500 ppm
I20260619 04:44:53.172818 32039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:53 dist-test-slave-9dgf krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844293, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:53.176043 32039 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:53.177642 32039 webserver.cc:460] Webserver started at http://127.9.224.126:39191/ using document root <none> and password file <none>
I20260619 04:44:53.178418 32039 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:53.178552 32039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:53.178929 32039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:53.181911 32039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "579be5c63d5446728865b83ff468248b"
format_stamp: "Formatted at 2026-06-19 04:44:53 on dist-test-slave-9dgf"
server_key: "a5ab5e2d0e2bb6608b736f04e4f446d8"
server_key_iv: "c1b69398c392523f28c8ebd37f671081"
server_key_version: "encryptionkey@0"
I20260619 04:44:53.182749 32039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "579be5c63d5446728865b83ff468248b"
format_stamp: "Formatted at 2026-06-19 04:44:53 on dist-test-slave-9dgf"
server_key: "a5ab5e2d0e2bb6608b736f04e4f446d8"
server_key_iv: "c1b69398c392523f28c8ebd37f671081"
server_key_version: "encryptionkey@0"
I20260619 04:44:53.188037 32039 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 04:44:53.191670 32054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:53.193074 32039 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:44:53.193272 32039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "579be5c63d5446728865b83ff468248b"
format_stamp: "Formatted at 2026-06-19 04:44:53 on dist-test-slave-9dgf"
server_key: "a5ab5e2d0e2bb6608b736f04e4f446d8"
server_key_iv: "c1b69398c392523f28c8ebd37f671081"
server_key_version: "encryptionkey@0"
I20260619 04:44:53.193485 32039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:53.199415 32039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:53.203362 32039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:53.203652 32039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:53.221939 32039 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:33629
I20260619 04:44:53.221998 32105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:33629 every 8 connection(s)
I20260619 04:44:53.223420 32039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:53.224623 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32039
I20260619 04:44:53.224823 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:53.225274 10113 external_mini_cluster.cc:1428] Setting key 8f81740724019c4aa159452ecede6cf2
I20260619 04:44:53.228045 32106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:53.233158 32109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:53.227183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58413 (local address 127.9.224.126:33629)
0619 04:44:53.228014 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:53.228026 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:53.228073 (+ 47us) server_negotiation.cc:407] Connection header received
0619 04:44:53.229680 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:53.229701 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:53.230023 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:53.230424 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:53.231534 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:53.231540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:53.231553 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:53.231568 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:53.231643 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:53.231667 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:53.231833 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:53.231948 (+ 115us) server_negotiation.cc:299] Negotiation successful
0619 04:44:53.232165 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":353,"threads_started":1}
I20260619 04:44:53.236766 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:53.239878 32106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b: Bootstrap starting.
I20260619 04:44:53.243697 32109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:53.240977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35365 (local address 127.9.224.126:33629)
0619 04:44:53.241192 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:53.241201 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:53.241716 (+ 515us) server_negotiation.cc:407] Connection header received
0619 04:44:53.241893 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:53.241896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:53.241943 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:53.242034 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:53.243029 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:53.243034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:53.243039 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:53.243053 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:53.243089 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:53.243104 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:53.243192 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:53.243334 (+ 142us) server_negotiation.cc:299] Negotiation successful
0619 04:44:53.243378 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:44:53.243834 32106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:53.244992 32106 log.cc:824] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:53.247685 32106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b: No bootstrap required, opened a new log
I20260619 04:44:53.255637 32106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579be5c63d5446728865b83ff468248b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33629 } }
I20260619 04:44:53.256026 32106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:53.256147 32106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 579be5c63d5446728865b83ff468248b, State: Initialized, Role: FOLLOWER
I20260619 04:44:53.256794 32106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579be5c63d5446728865b83ff468248b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33629 } }
I20260619 04:44:53.257030 32106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:53.257164 32106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:53.257347 32106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:53.259697 32106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579be5c63d5446728865b83ff468248b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33629 } }
I20260619 04:44:53.260305 32106 leader_election.cc:302] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 579be5c63d5446728865b83ff468248b; no voters:
I20260619 04:44:53.260975 32106 leader_election.cc:288] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:53.261137 32116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:53.261801 32116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [term 1 LEADER]: Becoming Leader. State: Replica: 579be5c63d5446728865b83ff468248b, State: Running, Role: LEADER
I20260619 04:44:53.262372 32116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579be5c63d5446728865b83ff468248b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33629 } }
I20260619 04:44:53.263113 32106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:53.265156 32118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 579be5c63d5446728865b83ff468248b. Latest consensus state: current_term: 1 leader_uuid: "579be5c63d5446728865b83ff468248b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579be5c63d5446728865b83ff468248b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33629 } } }
I20260619 04:44:53.265571 32118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:53.266453 32117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "579be5c63d5446728865b83ff468248b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579be5c63d5446728865b83ff468248b" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 33629 } } }
I20260619 04:44:53.266896 32117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:53.273675 32121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:53.279081 32121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:53.288484 32121 catalog_manager.cc:1347] Generated new cluster ID: 3e938bc0780d48adaf6d4dbfedde1674
I20260619 04:44:53.288604 32121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:53.300850 32121 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:53.301334 32121 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:53.310716 32121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 579be5c63d5446728865b83ff468248b: Generated new TSK 0
I20260619 04:44:53.311591 32121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:53.320719 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32039
W20260619 04:44:53.322134 32101 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58413
W20260619 04:44:53.323035 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32039: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:53.323182 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32039
2026-06-19T04:44:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1930 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:53 dist-test-slave-9dgf krb5kdc[32137](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:53 dist-test-slave-9dgf krb5kdc[32137](info): set up 2 sockets
Jun 19 04:44:53 dist-test-slave-9dgf krb5kdc[32137](info): commencing operation
krb5kdc: starting...
W20260619 04:44:54.438869 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:54 dist-test-slave-9dgf krb5kdc[32137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:54.709424 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37649
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:37649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:55.057978 32150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:55.058369 32150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:55.058545 32150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:55.065917 32150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:55.066102 32150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:55.066219 32150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:55.066362 32150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:55.066452 32150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:55.076561 32150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:37649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:55.078001 32150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:55.079468 32150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:55.091787 32155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:55.091764 32156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:55.091725 32158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:55.092528 32150 server_base.cc:1034] running on GCE node
I20260619 04:44:55.093379 32150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:55.095029 32150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:55.096282 32150 hybrid_clock.cc:648] HybridClock initialized: now 1781844295096231 us; error 80 us; skew 500 ppm
I20260619 04:44:55.096668 32150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:55 dist-test-slave-9dgf krb5kdc[32137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844295, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:55.100029 32150 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:55.101514 32150 webserver.cc:460] Webserver started at http://127.9.224.126:44087/ using document root <none> and password file <none>
I20260619 04:44:55.102173 32150 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:55.102365 32150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:55.102644 32150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:55.105648 32150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "7fc5e8dcccba419586f5b5c4d657e43a"
format_stamp: "Formatted at 2026-06-19 04:44:55 on dist-test-slave-9dgf"
server_key: "9f15f172ea5e60e5328167f09bcdd406"
server_key_iv: "f4e9b3dbbee6969154501fc9278589ab"
server_key_version: "encryptionkey@0"
I20260619 04:44:55.106599 32150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "7fc5e8dcccba419586f5b5c4d657e43a"
format_stamp: "Formatted at 2026-06-19 04:44:55 on dist-test-slave-9dgf"
server_key: "9f15f172ea5e60e5328167f09bcdd406"
server_key_iv: "f4e9b3dbbee6969154501fc9278589ab"
server_key_version: "encryptionkey@0"
I20260619 04:44:55.112085 32150 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 04:44:55.115921 32165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:55.117437 32150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 04:44:55.117627 32150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "7fc5e8dcccba419586f5b5c4d657e43a"
format_stamp: "Formatted at 2026-06-19 04:44:55 on dist-test-slave-9dgf"
server_key: "9f15f172ea5e60e5328167f09bcdd406"
server_key_iv: "f4e9b3dbbee6969154501fc9278589ab"
server_key_version: "encryptionkey@0"
I20260619 04:44:55.117820 32150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:55.131592 32150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:55.136005 32150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:55.136320 32150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:55.155818 32150 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:37649
I20260619 04:44:55.155850 32216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:37649 every 8 connection(s)
I20260619 04:44:55.157267 32150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:55.161249 32217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:55.165653 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32150
I20260619 04:44:55.165827 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:55.166411 10113 external_mini_cluster.cc:1428] Setting key b53fdb58c0744acf18ab4ddab1e7fe2c
I20260619 04:44:55.175791 32217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a: Bootstrap starting.
I20260619 04:44:55.180289 32217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:55.181800 32217 log.cc:824] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a: Log is configured to *not* fsync() on all Append() calls
Jun 19 04:44:55 dist-test-slave-9dgf krb5kdc[32137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:44:55.185205 32217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a: No bootstrap required, opened a new log
I20260619 04:44:55.191063 32220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:55.168335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57813 (local address 127.9.224.126:37649)
0619 04:44:55.169188 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:55.169200 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:55.169245 (+ 45us) server_negotiation.cc:407] Connection header received
0619 04:44:55.170961 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:55.170985 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:55.171418 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:55.171785 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:55.173824 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:55.175245 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:55.177226 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:55.177966 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:55.178106 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:55.183282 (+ 5176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:55.183291 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:55.183307 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:55.183344 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:55.186683 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:55.187462 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:55.187468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:55.187475 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:55.187651 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:55.188049 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:55.188054 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:55.188060 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:55.188621 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:55.188995 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:55.189433 (+ 438us) server_negotiation.cc:299] Negotiation successful
0619 04:44:55.189914 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":399,"threads_started":1}
I20260619 04:44:55.194710 32217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37649 } }
I20260619 04:44:55.195184 32217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:55.195317 32217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc5e8dcccba419586f5b5c4d657e43a, State: Initialized, Role: FOLLOWER
I20260619 04:44:55.195375 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:55.195983 32217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37649 } }
I20260619 04:44:55.196254 32217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:55.196420 32217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:55.196609 32217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:55.200482 32217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37649 } }
I20260619 04:44:55.201267 32217 leader_election.cc:302] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fc5e8dcccba419586f5b5c4d657e43a; no voters:
I20260619 04:44:55.202273 32217 leader_election.cc:288] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:55.202414 32227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:55.207688 32227 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [term 1 LEADER]: Becoming Leader. State: Replica: 7fc5e8dcccba419586f5b5c4d657e43a, State: Running, Role: LEADER
I20260619 04:44:55.208362 32227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37649 } }
I20260619 04:44:55.209959 32217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:55.211681 32229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37649 } } }
I20260619 04:44:55.212097 32229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:55.212357 32228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fc5e8dcccba419586f5b5c4d657e43a. Latest consensus state: current_term: 1 leader_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fc5e8dcccba419586f5b5c4d657e43a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37649 } } }
I20260619 04:44:55.212654 32228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:55.213364 32232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:55.221663 32220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:55.200396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38789 (local address 127.9.224.126:37649)
0619 04:44:55.200617 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:55.200627 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:55.201197 (+ 570us) server_negotiation.cc:407] Connection header received
0619 04:44:55.201410 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:55.201417 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:55.201528 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:55.201627 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:55.204094 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:55.205580 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:55.207436 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:55.208199 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:55.208323 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:55.211360 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:55.211367 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:55.211373 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:44:55.211423 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:55.215962 (+ 4539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:55.217138 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:55.217147 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:55.217154 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:55.217345 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:44:55.217952 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:44:55.217961 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:44:55.217967 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:44:55.218588 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:55.220424 (+ 1836us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:55.220630 (+ 206us) server_negotiation.cc:299] Negotiation successful
0619 04:44:55.220944 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:44:55.232213 32232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:55.243556 32232 catalog_manager.cc:1347] Generated new cluster ID: 918b0f9d7a534d4084b30c72272cb10f
I20260619 04:44:55.243736 32232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:55.270749 32232 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:55.272696 32232 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:55.279902 32232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fc5e8dcccba419586f5b5c4d657e43a: Generated new TSK 0
I20260619 04:44:55.280987 32232 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:55.289394 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32150
I20260619 04:44:55.290680 32212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:44:55.383951 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32150
2026-06-19T04:44:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2060 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:55 dist-test-slave-9dgf krb5kdc[32249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:55 dist-test-slave-9dgf krb5kdc[32249](info): set up 2 sockets
Jun 19 04:44:55 dist-test-slave-9dgf krb5kdc[32249](info): commencing operation
krb5kdc: starting...
W20260619 04:44:56.494866 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:56 dist-test-slave-9dgf krb5kdc[32249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:56.769361 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:35673
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:35657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:35673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:57.106345 32262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:57.106662 32262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:57.106757 32262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:57.114604 32262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:57.114727 32262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:57.114773 32262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:57.114835 32262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:57.114878 32262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:57.125464 32262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:35657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:35673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:35673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:57.126962 32262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:57.128293 32262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:57.140503 32267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:57.140317 32270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:57.140401 32268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:57.141808 32262 server_base.cc:1034] running on GCE node
I20260619 04:44:57.142730 32262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:57.144264 32262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:57.145474 32262 hybrid_clock.cc:648] HybridClock initialized: now 1781844297145420 us; error 41 us; skew 500 ppm
I20260619 04:44:57.145860 32262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:57 dist-test-slave-9dgf krb5kdc[32249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844297, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:57.149151 32262 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:57.150755 32262 webserver.cc:460] Webserver started at http://127.9.224.126:39095/ using document root <none> and password file <none>
I20260619 04:44:57.151468 32262 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:57.151572 32262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:57.151856 32262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:57.155143 32262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "e043202d510144d2bf569e302c501dcc"
format_stamp: "Formatted at 2026-06-19 04:44:57 on dist-test-slave-9dgf"
server_key: "4b3c0a0ec6e10c1ab164c2c8ee032f95"
server_key_iv: "fb79641e15148f53655b00aa45e698d5"
server_key_version: "encryptionkey@0"
I20260619 04:44:57.155925 32262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "e043202d510144d2bf569e302c501dcc"
format_stamp: "Formatted at 2026-06-19 04:44:57 on dist-test-slave-9dgf"
server_key: "4b3c0a0ec6e10c1ab164c2c8ee032f95"
server_key_iv: "fb79641e15148f53655b00aa45e698d5"
server_key_version: "encryptionkey@0"
I20260619 04:44:57.161468 32262 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 04:44:57.165241 32277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:57.166782 32262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:44:57.166965 32262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "e043202d510144d2bf569e302c501dcc"
format_stamp: "Formatted at 2026-06-19 04:44:57 on dist-test-slave-9dgf"
server_key: "4b3c0a0ec6e10c1ab164c2c8ee032f95"
server_key_iv: "fb79641e15148f53655b00aa45e698d5"
server_key_version: "encryptionkey@0"
I20260619 04:44:57.167165 32262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:57.185683 32262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:57.189741 32262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:57.190023 32262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:57.208962 32262 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:35673
I20260619 04:44:57.208985 32328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:35673 every 8 connection(s)
I20260619 04:44:57.210412 32262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:57.214167 32329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:57.215515 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32262
I20260619 04:44:57.215679 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:57.216159 10113 external_mini_cluster.cc:1428] Setting key 61162024eccb26309b4ee8e2c42905bf
I20260619 04:44:57.228355 32329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc: Bootstrap starting.
I20260619 04:44:57.229992 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:57.217925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33703 (local address 127.9.224.126:35673)
0619 04:44:57.218781 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:57.218792 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:57.218836 (+ 44us) server_negotiation.cc:407] Connection header received
0619 04:44:57.220467 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:57.220493 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:57.220918 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:57.221265 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:57.221891 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:57.223250 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:57.225291 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:57.226051 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:57.226184 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:57.227558 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:57.227566 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:57.227582 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:57.228153 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:57.228239 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:57.228265 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:57.228364 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:57.228681 (+ 317us) server_negotiation.cc:299] Negotiation successful
0619 04:44:57.228998 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":401,"threads_started":1}
I20260619 04:44:57.231789 32329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:57.232983 32329 log.cc:824] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:57.233789 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:57.235821 32329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc: No bootstrap required, opened a new log
I20260619 04:44:57.243960 32329 raft_consensus.cc:348] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e043202d510144d2bf569e302c501dcc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35673 } }
I20260619 04:44:57.244437 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:57.238150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56135 (local address 127.9.224.126:35673)
0619 04:44:57.238345 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:57.238350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:57.238861 (+ 511us) server_negotiation.cc:407] Connection header received
0619 04:44:57.239059 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:57.239068 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:57.239138 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:57.239261 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:57.239780 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:57.240524 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:57.241888 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:44:57.242462 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:44:57.242613 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:44:57.243704 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:57.243709 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:57.243712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:57.243730 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:57.243768 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:57.243782 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:57.243878 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:57.244028 (+ 150us) server_negotiation.cc:299] Negotiation successful
0619 04:44:57.244115 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260619 04:44:57.244513 32329 raft_consensus.cc:374] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:57.244656 32329 raft_consensus.cc:729] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e043202d510144d2bf569e302c501dcc, State: Initialized, Role: FOLLOWER
I20260619 04:44:57.245329 32329 consensus_queue.cc:260] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e043202d510144d2bf569e302c501dcc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35673 } }
I20260619 04:44:57.245620 32329 raft_consensus.cc:388] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:57.245781 32329 raft_consensus.cc:482] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:57.245971 32329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:57.248409 32329 raft_consensus.cc:504] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e043202d510144d2bf569e302c501dcc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35673 } }
I20260619 04:44:57.248940 32329 leader_election.cc:302] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e043202d510144d2bf569e302c501dcc; no voters:
I20260619 04:44:57.249532 32329 leader_election.cc:288] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:57.249686 32339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:57.250412 32339 raft_consensus.cc:686] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [term 1 LEADER]: Becoming Leader. State: Replica: e043202d510144d2bf569e302c501dcc, State: Running, Role: LEADER
I20260619 04:44:57.251051 32339 consensus_queue.cc:237] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e043202d510144d2bf569e302c501dcc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35673 } }
I20260619 04:44:57.251997 32329 sys_catalog.cc:564] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:57.254374 32341 sys_catalog.cc:455] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader e043202d510144d2bf569e302c501dcc. Latest consensus state: current_term: 1 leader_uuid: "e043202d510144d2bf569e302c501dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e043202d510144d2bf569e302c501dcc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35673 } } }
I20260619 04:44:57.254868 32341 sys_catalog.cc:458] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:57.255400 32340 sys_catalog.cc:455] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e043202d510144d2bf569e302c501dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e043202d510144d2bf569e302c501dcc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 35673 } } }
I20260619 04:44:57.255736 32340 sys_catalog.cc:458] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:57.258728 32346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:57.264410 32346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:57.275136 32346 catalog_manager.cc:1347] Generated new cluster ID: 48b3dfbc5d4b439ba47e9f47bff3bdfd
I20260619 04:44:57.275350 32346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:57.289090 32346 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:57.290519 32346 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:57.299455 32346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e043202d510144d2bf569e302c501dcc: Generated new TSK 0
I20260619 04:44:57.300336 32346 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:57.313006 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32262
W20260619 04:44:57.314280 32324 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33703
W20260619 04:44:57.315049 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32262: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:57.315210 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32262
2026-06-19T04:44:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1931 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:57 dist-test-slave-9dgf krb5kdc[32360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:57 dist-test-slave-9dgf krb5kdc[32360](info): set up 2 sockets
Jun 19 04:44:57 dist-test-slave-9dgf krb5kdc[32360](info): commencing operation
krb5kdc: starting...
W20260619 04:44:58.442867 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.004s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:44:58 dist-test-slave-9dgf krb5kdc[32360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:44:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:44:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:44:58.707434 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37699
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:37699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:44:59.043677 32373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:44:59.044023 32373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:44:59.044203 32373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:44:59.051386 32373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:44:59.051528 32373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:44:59.051640 32373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:44:59.051749 32373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:44:59.051833 32373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:44:59.062886 32373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:37699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:37699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:44:59.064265 32373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:44:59.065606 32373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:44:59.077486 32379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:59.077566 32378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:44:59.077523 32381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:44:59.078521 32373 server_base.cc:1034] running on GCE node
I20260619 04:44:59.079298 32373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:44:59.080657 32373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:44:59.081856 32373 hybrid_clock.cc:648] HybridClock initialized: now 1781844299081817 us; error 29 us; skew 500 ppm
I20260619 04:44:59.082162 32373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:44:59 dist-test-slave-9dgf krb5kdc[32360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844299, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:44:59.085211 32373 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:44:59.086591 32373 webserver.cc:460] Webserver started at http://127.9.224.126:34831/ using document root <none> and password file <none>
I20260619 04:44:59.087217 32373 fs_manager.cc:359] Metadata directory not provided
I20260619 04:44:59.087314 32373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:44:59.087558 32373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:44:59.090449 32373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "70f96052dfa44ae5b88fafaee296cd3a"
format_stamp: "Formatted at 2026-06-19 04:44:59 on dist-test-slave-9dgf"
server_key: "71a3e1698ffffc276bf6b38a8ee14062"
server_key_iv: "4122108e028175da725bd4137f5b696a"
server_key_version: "encryptionkey@0"
I20260619 04:44:59.091161 32373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "70f96052dfa44ae5b88fafaee296cd3a"
format_stamp: "Formatted at 2026-06-19 04:44:59 on dist-test-slave-9dgf"
server_key: "71a3e1698ffffc276bf6b38a8ee14062"
server_key_iv: "4122108e028175da725bd4137f5b696a"
server_key_version: "encryptionkey@0"
I20260619 04:44:59.096251 32373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:44:59.099731 32388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:44:59.101064 32373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260619 04:44:59.101199 32373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "70f96052dfa44ae5b88fafaee296cd3a"
format_stamp: "Formatted at 2026-06-19 04:44:59 on dist-test-slave-9dgf"
server_key: "71a3e1698ffffc276bf6b38a8ee14062"
server_key_iv: "4122108e028175da725bd4137f5b696a"
server_key_version: "encryptionkey@0"
I20260619 04:44:59.101374 32373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:44:59.106835 32373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:44:59.110837 32373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:44:59.111071 32373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:44:59.128396 32373 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:37699
I20260619 04:44:59.128425 32439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:37699 every 8 connection(s)
I20260619 04:44:59.129803 32373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:44:59.133462 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32373
I20260619 04:44:59.133658 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:44:59.133698 32440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:44:59.134083 10113 external_mini_cluster.cc:1428] Setting key 5b89cb43a5d5d60d41dc99a0a4cb6a48
I20260619 04:44:59.142793 32443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:59.135962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41329 (local address 127.9.224.126:37699)
0619 04:44:59.136915 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:59.136935 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:59.136989 (+ 54us) server_negotiation.cc:407] Connection header received
0619 04:44:59.138879 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:59.138909 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:59.139375 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:59.139839 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:59.140840 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:59.140849 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:59.140871 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:59.140888 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:59.140961 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:59.140985 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:59.141225 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:59.141351 (+ 126us) server_negotiation.cc:299] Negotiation successful
0619 04:44:59.141556 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":427,"threads_started":1}
I20260619 04:44:59.146602 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:44:59.148612 32440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a: Bootstrap starting.
I20260619 04:44:59.152048 32440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a: Neither blocks nor log segments found. Creating new log.
I20260619 04:44:59.153275 32443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:44:59.150906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40191 (local address 127.9.224.126:37699)
0619 04:44:59.151071 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0619 04:44:59.151077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:44:59.151437 (+ 360us) server_negotiation.cc:407] Connection header received
0619 04:44:59.151563 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:44:59.151568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:44:59.151625 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:44:59.151734 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:44:59.152635 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:44:59.152640 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:44:59.152645 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 04:44:59.152663 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:44:59.152706 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 04:44:59.152725 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:44:59.152840 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 04:44:59.152911 (+ 71us) server_negotiation.cc:299] Negotiation successful
0619 04:44:59.152967 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 04:44:59.153340 32440 log.cc:824] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a: Log is configured to *not* fsync() on all Append() calls
I20260619 04:44:59.156131 32440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a: No bootstrap required, opened a new log
I20260619 04:44:59.163693 32440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f96052dfa44ae5b88fafaee296cd3a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37699 } }
I20260619 04:44:59.164080 32440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 04:44:59.164208 32440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70f96052dfa44ae5b88fafaee296cd3a, State: Initialized, Role: FOLLOWER
I20260619 04:44:59.164732 32440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f96052dfa44ae5b88fafaee296cd3a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37699 } }
I20260619 04:44:59.164942 32440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 04:44:59.165040 32440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 04:44:59.165218 32440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:44:59.167567 32440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f96052dfa44ae5b88fafaee296cd3a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37699 } }
I20260619 04:44:59.168103 32440 leader_election.cc:302] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70f96052dfa44ae5b88fafaee296cd3a; no voters:
I20260619 04:44:59.168666 32440 leader_election.cc:288] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 04:44:59.168803 32450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:44:59.169526 32450 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [term 1 LEADER]: Becoming Leader. State: Replica: 70f96052dfa44ae5b88fafaee296cd3a, State: Running, Role: LEADER
I20260619 04:44:59.170053 32450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f96052dfa44ae5b88fafaee296cd3a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37699 } }
I20260619 04:44:59.170859 32440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:44:59.173125 32452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70f96052dfa44ae5b88fafaee296cd3a. Latest consensus state: current_term: 1 leader_uuid: "70f96052dfa44ae5b88fafaee296cd3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f96052dfa44ae5b88fafaee296cd3a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37699 } } }
I20260619 04:44:59.173564 32452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:59.173791 32451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70f96052dfa44ae5b88fafaee296cd3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f96052dfa44ae5b88fafaee296cd3a" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 37699 } } }
I20260619 04:44:59.174156 32451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a [sys.catalog]: This master's current role is: LEADER
I20260619 04:44:59.175920 32456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 04:44:59.182566 32456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:44:59.191746 32456 catalog_manager.cc:1347] Generated new cluster ID: 54a942e05cbc40069f21c95cd54f911b
I20260619 04:44:59.191874 32456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:44:59.211321 32456 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:44:59.211766 32456 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:44:59.228080 32456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70f96052dfa44ae5b88fafaee296cd3a: Generated new TSK 0
I20260619 04:44:59.228974 32456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:44:59.244107 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32373
W20260619 04:44:59.245307 32435 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41329
W20260619 04:44:59.246037 10113 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32373: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 04:44:59.246183 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32373
2026-06-19T04:44:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1930 ms)
[----------] 18 tests from AuthTokenIssuingTest (35689 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:44:59 dist-test-slave-9dgf krb5kdc[32471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:44:59 dist-test-slave-9dgf krb5kdc[32471](info): set up 2 sockets
Jun 19 04:44:59 dist-test-slave-9dgf krb5kdc[32471](info): commencing operation
krb5kdc: starting...
W20260619 04:45:00.358976 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.008s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:45:00 dist-test-slave-9dgf krb5kdc[32471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:45:00.633744 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46509
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46509,127.9.224.125:42055,127.9.224.124:33747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:45:00.972791 32484 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 04:45:00.973206 32484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:45:00.973348 32484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:45:00.973497 32484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:45:00.980845 32484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:45:00.980963 32484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:45:00.981091 32484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:45:00.981215 32484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:45:00.981318 32484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:45:00.991684 32484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46509,127.9.224.125:42055,127.9.224.124:33747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:45:00.993072 32484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:45:00.994417 32484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:45:01.006649 32489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:01.006626 32490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:01.006677 32492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:45:01.007901 32484 server_base.cc:1034] running on GCE node
I20260619 04:45:01.008800 32484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:45:01.010294 32484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:45:01.011520 32484 hybrid_clock.cc:648] HybridClock initialized: now 1781844301011462 us; error 34 us; skew 500 ppm
I20260619 04:45:01.011878 32484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:45:01 dist-test-slave-9dgf krb5kdc[32471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:45:01.015115 32484 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:45:01.016564 32484 webserver.cc:460] Webserver started at http://127.9.224.126:33371/ using document root <none> and password file <none>
I20260619 04:45:01.017271 32484 fs_manager.cc:359] Metadata directory not provided
I20260619 04:45:01.017387 32484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:45:01.017709 32484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:45:01.020818 32484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "7b65a5fadb2b46ad902fbff136046531"
format_stamp: "Formatted at 2026-06-19 04:45:01 on dist-test-slave-9dgf"
server_key: "b9d225954ec8a9383117f6f533cf7491"
server_key_iv: "1d75934d8ea4406d1f1c1a98f65cf2c9"
server_key_version: "encryptionkey@0"
I20260619 04:45:01.021623 32484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "7b65a5fadb2b46ad902fbff136046531"
format_stamp: "Formatted at 2026-06-19 04:45:01 on dist-test-slave-9dgf"
server_key: "b9d225954ec8a9383117f6f533cf7491"
server_key_iv: "1d75934d8ea4406d1f1c1a98f65cf2c9"
server_key_version: "encryptionkey@0"
I20260619 04:45:01.026824 32484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 04:45:01.030373 32499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:45:01.031790 32484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 04:45:01.031989 32484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "7b65a5fadb2b46ad902fbff136046531"
format_stamp: "Formatted at 2026-06-19 04:45:01 on dist-test-slave-9dgf"
server_key: "b9d225954ec8a9383117f6f533cf7491"
server_key_iv: "1d75934d8ea4406d1f1c1a98f65cf2c9"
server_key_version: "encryptionkey@0"
I20260619 04:45:01.032224 32484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:45:01.049755 32484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:45:01.054095 32484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:45:01.054423 32484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:45:01.073770 32484 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:46509
I20260619 04:45:01.073770 32550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:46509 every 8 connection(s)
I20260619 04:45:01.075254 32484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:45:01.079095 32551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:45:01.080322 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32484
I20260619 04:45:01.080552 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:45:01.081367 10113 external_mini_cluster.cc:1428] Setting key 93f80fbf64e283121b3ddcdf19e55ebb
I20260619 04:45:01.089067 32551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:01 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.125@KRBTEST.COM" created.
I20260619 04:45:01.113106 32555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.093431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35468 (local address 127.9.224.126:46509)
0619 04:45:01.094512 (+ 1081us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:01.094530 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:01.094747 (+ 217us) server_negotiation.cc:407] Connection header received
0619 04:45:01.096779 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:01.096785 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:01.097010 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:01.097226 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:01.098582 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.099912 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.101270 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.101833 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.102045 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.105625 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:01.105633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:01.105645 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:01.105677 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:01.108478 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.109151 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.109158 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.109160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.109299 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.109721 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.109727 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.109735 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.110206 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:01.110552 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:01.111164 (+ 612us) server_negotiation.cc:299] Negotiation successful
0619 04:45:01.111567 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":883,"spinlock_wait_cycles":27904,"thread_start_us":529,"threads_started":1}
I20260619 04:45:01.113073 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.093431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46509 (local address 127.0.0.1:35468)
0619 04:45:01.094584 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.094632 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:01.096402 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:01.097238 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:01.097245 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:01.097971 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:01.098374 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.098392 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.100070 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.100075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.101129 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.101141 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.102074 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.102081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.102299 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.102987 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:01.103009 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:01.105400 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:01.108605 (+ 3205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.108618 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.108630 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.109010 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.109415 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.109419 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.109423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.109611 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.110439 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:01.110446 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:01.110730 (+ 284us) client_negotiation.cc:769] Sending connection context
0619 04:45:01.111021 (+ 291us) client_negotiation.cc:240] Negotiation successful
0619 04:45:01.111678 (+ 657us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":189,"thread_start_us":527,"threads_started":1}
I20260619 04:45:01.116356 32551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:01.117398 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.117015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47298)
0619 04:45:01.117175 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.117284 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260619 04:45:01.117626 32501 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
I20260619 04:45:01.119277 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.118871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47304)
0619 04:45:01.119063 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.119134 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260619 04:45:01.119518 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:42055: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab.
Entry for principal kudu/127.9.224.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab.
I20260619 04:45:01.141662 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:42055
--webserver_interface=127.9.224.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab
--principal=kudu/127.9.224.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46509,127.9.224.125:42055,127.9.224.124:33747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:45:01.168905 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } attempt: 1
I20260619 04:45:01.170162 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.169602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47308)
0619 04:45:01.169846 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.169988 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 04:45:01.171288 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.170880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47316)
0619 04:45:01.171040 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.171131 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 04:45:01.171469 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:42055: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
I20260619 04:45:01.239729 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } attempt: 2
I20260619 04:45:01.241214 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.240488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47324)
0619 04:45:01.240835 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.240997 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 04:45:01.242403 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.241936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47338)
0619 04:45:01.242107 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.242198 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:45:01.242602 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:42055: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
I20260619 04:45:01.333918 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } attempt: 3
I20260619 04:45:01.335371 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.334713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47348)
0619 04:45:01.334990 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.335163 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260619 04:45:01.336762 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.336216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47356)
0619 04:45:01.336417 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.336519 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260619 04:45:01.336971 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:42055: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
W20260619 04:45:01.479694 32558 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 04:45:01.480201 32558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:45:01.480332 32558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260619 04:45:01.480204 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } attempt: 4
W20260619 04:45:01.480504 32558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260619 04:45:01.481580 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.480991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47368)
0619 04:45:01.481301 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.481409 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
I20260619 04:45:01.482645 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.482223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47378)
0619 04:45:01.482407 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.482500 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 04:45:01.482867 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:42055: Network error: Client connection negotiation failed: client connection to 127.9.224.125:42055: connect: Connection refused (error 111)
W20260619 04:45:01.488873 32558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:45:01.488955 32558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:45:01.489079 32558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:45:01.489169 32558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:45:01.489269 32558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:45:01.499419 32558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46509,127.9.224.125:42055,127.9.224.124:33747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab
--principal=kudu/127.9.224.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:42055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.224.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:45:01.500811 32558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:45:01.502097 32558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:45:01.513511 32563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:01.513612 32566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:01.513607 32564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:45:01.514528 32558 server_base.cc:1034] running on GCE node
I20260619 04:45:01.515318 32558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:45:01.516696 32558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:45:01.517921 32558 hybrid_clock.cc:648] HybridClock initialized: now 1781844301517862 us; error 36 us; skew 500 ppm
I20260619 04:45:01.518205 32558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:45:01 dist-test-slave-9dgf krb5kdc[32471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:45:01.521471 32558 init.cc:377] Logged in from keytab as kudu/127.9.224.125@KRBTEST.COM (short username kudu)
I20260619 04:45:01.522966 32558 webserver.cc:460] Webserver started at http://127.9.224.125:43283/ using document root <none> and password file <none>
I20260619 04:45:01.523694 32558 fs_manager.cc:359] Metadata directory not provided
I20260619 04:45:01.523830 32558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:45:01.524210 32558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:45:01.527407 32558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data/instance:
uuid: "3e631a1265eb4050b8ec38a6afc24013"
format_stamp: "Formatted at 2026-06-19 04:45:01 on dist-test-slave-9dgf"
server_key: "30d99dd1d722d16ad8e5ff650b4bce93"
server_key_iv: "ff2be6fe5c2694573389458ab731a9e7"
server_key_version: "encryptionkey@0"
I20260619 04:45:01.528225 32558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal/instance:
uuid: "3e631a1265eb4050b8ec38a6afc24013"
format_stamp: "Formatted at 2026-06-19 04:45:01 on dist-test-slave-9dgf"
server_key: "30d99dd1d722d16ad8e5ff650b4bce93"
server_key_iv: "ff2be6fe5c2694573389458ab731a9e7"
server_key_version: "encryptionkey@0"
I20260619 04:45:01.533658 32558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:45:01.537741 32573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:45:01.539287 32558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 04:45:01.539477 32558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal
uuid: "3e631a1265eb4050b8ec38a6afc24013"
format_stamp: "Formatted at 2026-06-19 04:45:01 on dist-test-slave-9dgf"
server_key: "30d99dd1d722d16ad8e5ff650b4bce93"
server_key_iv: "ff2be6fe5c2694573389458ab731a9e7"
server_key_version: "encryptionkey@0"
I20260619 04:45:01.539709 32558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:45:01.593686 32558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:45:01.598863 32558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:45:01.599177 32558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:45:01.618755 32558 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.125:42055
I20260619 04:45:01.618795 32624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.125:42055 every 8 connection(s)
I20260619 04:45:01.620283 32558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
I20260619 04:45:01.624303 32625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:45:01.627794 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32558
I20260619 04:45:01.628046 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-1/wal/instance
I20260619 04:45:01.628611 10113 external_mini_cluster.cc:1428] Setting key 1af3b7fbfd08fb40f2cfd54f2161e4b9
I20260619 04:45:01.634022 32625 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:01 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.124@KRBTEST.COM" created.
I20260619 04:45:01.659981 32627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.637879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35482 (local address 127.9.224.126:46509)
0619 04:45:01.638520 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:01.638529 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:01.639634 (+ 1105us) server_negotiation.cc:407] Connection header received
0619 04:45:01.642652 (+ 3018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:01.642657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:01.642734 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:01.642849 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:01.645307 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.646085 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.648687 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.649123 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.649230 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.653711 (+ 4481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:01.653717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:01.653720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:01.653775 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:01.656525 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.657354 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.657359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.657361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.657484 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.657984 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.657988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.657990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.658334 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:01.658506 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:01.659340 (+ 834us) server_negotiation.cc:299] Negotiation successful
0619 04:45:01.659569 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":325,"threads_started":1}
I20260619 04:45:01.661103 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.638557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46509 (local address 127.0.0.1:35482)
0619 04:45:01.639430 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.639485 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:01.642262 (+ 2777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:01.643213 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:01.643230 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:01.644102 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:01.645017 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.645047 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.646298 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.646307 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.648491 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.648511 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.649381 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.649391 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.649752 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.650618 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:01.650659 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:01.653433 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:01.656690 (+ 3257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.656700 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.656718 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.657177 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.657601 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.657606 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.657610 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.657854 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.658488 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:01.658497 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:01.658947 (+ 450us) client_negotiation.cc:769] Sending connection context
0619 04:45:01.659237 (+ 290us) client_negotiation.cc:240] Negotiation successful
0619 04:45:01.659925 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":389,"threads_started":1}
I20260619 04:45:01.663112 32625 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:01 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:45:01.677455 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.664057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47380)
0619 04:45:01.664224 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.664251 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:01.664382 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:01.665133 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:01.665137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:01.665592 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:01.665722 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.665730 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.667184 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.667192 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.668039 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.668050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.668882 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.668887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.669079 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.669670 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:01.669687 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:01.671752 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:01.674972 (+ 3220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.674980 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.674984 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.675350 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.675718 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.675725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.675728 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.675868 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.676442 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:01.676452 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:01.676587 (+ 135us) client_negotiation.cc:769] Sending connection context
0619 04:45:01.676739 (+ 152us) client_negotiation.cc:240] Negotiation successful
0619 04:45:01.677016 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260619 04:45:01.677495 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.664137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47380 (local address 127.9.224.125:42055)
0619 04:45:01.664734 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:01.664739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:01.664765 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:45:01.664805 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:01.664811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:01.664993 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:01.665146 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:01.665905 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.667054 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.668185 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.668735 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.668875 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.671959 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:01.671970 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:01.671986 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:01.672019 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:01.674846 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.675478 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.675492 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.675494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.675612 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.675969 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.675976 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.675979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.676321 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:01.676534 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:01.676911 (+ 377us) server_negotiation.cc:299] Negotiation successful
0619 04:45:01.677131 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":295,"threads_started":1}
I20260619 04:45:01.680465 32625 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:01.681847 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.681356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41146)
0619 04:45:01.681549 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.681663 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:45:01.682180 32577 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:01.683962 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.683606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41154)
0619 04:45:01.683756 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.683844 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 04:45:01.684198 32625 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab.
Entry for principal kudu/127.9.224.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab.
I20260619 04:45:01.693337 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:33747
--webserver_interface=127.9.224.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab
--principal=kudu/127.9.224.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46509,127.9.224.125:42055,127.9.224.124:33747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:45:01.733515 32625 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 1
I20260619 04:45:01.734778 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.734164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41164)
0619 04:45:01.734453 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.734584 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260619 04:45:01.735905 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.735453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41180)
0619 04:45:01.735653 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.735764 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 04:45:01.736145 32625 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:01.782132 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } attempt: 5
Jun 19 04:45:01 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:45:01.796866 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.783235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47382 (local address 127.9.224.125:42055)
0619 04:45:01.783483 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:01.783489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:01.783515 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:45:01.783566 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:01.783570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:01.783645 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:01.783776 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:01.784776 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.785573 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.786940 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.787404 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.787559 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.791338 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:01.791344 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:01.791347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:01.791386 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:01.794131 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.794905 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.794909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.794911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.795039 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:01.795420 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:01.795426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:01.795429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:01.795732 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:01.795889 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:01.796266 (+ 377us) server_negotiation.cc:299] Negotiation successful
0619 04:45:01.796492 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260619 04:45:01.796866 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.782984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47382)
0619 04:45:01.783189 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.783215 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:01.783367 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:01.783804 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:01.783810 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:01.784248 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:01.784442 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.784452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.785747 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.785754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.786749 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:01.786772 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:01.787586 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:01.787601 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:01.787825 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:01.788838 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:01.788858 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:01.791080 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:01.794333 (+ 3253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.794339 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.794343 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.794755 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.795154 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:01.795159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:01.795163 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:01.795308 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:01.795852 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:01.795857 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:01.796022 (+ 165us) client_negotiation.cc:769] Sending connection context
0619 04:45:01.796169 (+ 147us) client_negotiation.cc:240] Negotiation successful
0619 04:45:01.796510 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260619 04:45:01.798382 32551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:01.799469 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.799068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41196)
0619 04:45:01.799249 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.799331 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260619 04:45:01.800365 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.800046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41210)
0619 04:45:01.800208 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.800274 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260619 04:45:01.800586 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:01.804405 32625 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 2
I20260619 04:45:01.805529 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.805028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41218)
0619 04:45:01.805240 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.805347 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260619 04:45:01.806619 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.806199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41230)
0619 04:45:01.806377 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.806466 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260619 04:45:01.806910 32625 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:01.851820 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 1
I20260619 04:45:01.853193 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.852518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41240)
0619 04:45:01.852804 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.852951 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260619 04:45:01.854338 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.853921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41246)
0619 04:45:01.854073 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.854153 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 04:45:01.854542 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:01.898161 32625 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 3
I20260619 04:45:01.899468 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.899005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41250)
0619 04:45:01.899212 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.899308 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 04:45:01.900496 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.900103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41254)
0619 04:45:01.900318 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.900398 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
W20260619 04:45:01.900684 32625 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:01.922755 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 2
I20260619 04:45:01.923961 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.923472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41256)
0619 04:45:01.923709 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.923797 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 04:45:01.924952 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:01.924593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41266)
0619 04:45:01.924732 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:01.924815 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 04:45:01.925312 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
I20260619 04:45:02.031567 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 3
I20260619 04:45:02.032742 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.032250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41270)
0619 04:45:02.032459 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.032557 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260619 04:45:02.034049 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.033476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41280)
0619 04:45:02.033769 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.033872 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260619 04:45:02.034446 32551 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
W20260619 04:45:02.041620 32633 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 04:45:02.042016 32633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:45:02.042147 32633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:45:02.042325 32633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260619 04:45:02.043865 32625 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 4
I20260619 04:45:02.044910 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.044478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41286)
0619 04:45:02.044656 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.044744 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260619 04:45:02.045842 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.045505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41298)
0619 04:45:02.045653 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.045726 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260619 04:45:02.046048 32625 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:33747: Network error: Client connection negotiation failed: client connection to 127.9.224.124:33747: connect: Connection refused (error 111)
W20260619 04:45:02.050680 32633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:45:02.050767 32633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:45:02.050877 32633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:45:02.050954 32633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:45:02.051070 32633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:45:02.061640 32633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46509,127.9.224.125:42055,127.9.224.124:33747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab
--principal=kudu/127.9.224.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:33747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.224.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:45:02.063138 32633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:45:02.064539 32633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:45:02.079231 32639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:02.079267 32641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:02.080485 32638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:45:02.080808 32633 server_base.cc:1034] running on GCE node
I20260619 04:45:02.081677 32633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:45:02.083319 32633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:45:02.084633 32633 hybrid_clock.cc:648] HybridClock initialized: now 1781844302084561 us; error 45 us; skew 500 ppm
I20260619 04:45:02.084944 32633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844302, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:45:02.088251 32633 init.cc:377] Logged in from keytab as kudu/127.9.224.124@KRBTEST.COM (short username kudu)
I20260619 04:45:02.089829 32633 webserver.cc:460] Webserver started at http://127.9.224.124:46211/ using document root <none> and password file <none>
I20260619 04:45:02.090611 32633 fs_manager.cc:359] Metadata directory not provided
I20260619 04:45:02.090705 32633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:45:02.090970 32633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:45:02.094038 32633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data/instance:
uuid: "5a5de236c0594860a196b61bf1f592bc"
format_stamp: "Formatted at 2026-06-19 04:45:02 on dist-test-slave-9dgf"
server_key: "522dedf9c9dcf0ea0b52b92227eaf1cc"
server_key_iv: "3c7350ffb23fb5ac76934076a0b74592"
server_key_version: "encryptionkey@0"
I20260619 04:45:02.094936 32633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal/instance:
uuid: "5a5de236c0594860a196b61bf1f592bc"
format_stamp: "Formatted at 2026-06-19 04:45:02 on dist-test-slave-9dgf"
server_key: "522dedf9c9dcf0ea0b52b92227eaf1cc"
server_key_iv: "3c7350ffb23fb5ac76934076a0b74592"
server_key_version: "encryptionkey@0"
I20260619 04:45:02.100601 32633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:45:02.104635 32648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:45:02.106138 32633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 04:45:02.106412 32633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal
uuid: "5a5de236c0594860a196b61bf1f592bc"
format_stamp: "Formatted at 2026-06-19 04:45:02 on dist-test-slave-9dgf"
server_key: "522dedf9c9dcf0ea0b52b92227eaf1cc"
server_key_iv: "3c7350ffb23fb5ac76934076a0b74592"
server_key_version: "encryptionkey@0"
I20260619 04:45:02.106678 32633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:45:02.123205 32633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:45:02.128115 32633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:45:02.128451 32633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:45:02.148079 32633 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.124:33747
I20260619 04:45:02.148087 32699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.124:33747 every 8 connection(s)
I20260619 04:45:02.149609 32633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
I20260619 04:45:02.153509 32700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:45:02.159991 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 32633
I20260619 04:45:02.160244 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781843940819459-10113-0/minicluster-data/master-2/wal/instance
I20260619 04:45:02.160758 10113 external_mini_cluster.cc:1428] Setting key 7807c7d3e3f6dac0217893080dc0dbe6
I20260619 04:45:02.160471 32700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844302, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
I20260619 04:45:02.182337 32704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.163463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.9.224.126:46509)
0619 04:45:02.164036 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.164042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.164666 (+ 624us) server_negotiation.cc:407] Connection header received
0619 04:45:02.166490 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.166496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.166592 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.166716 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.168143 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.168889 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.170661 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.171172 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.171311 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.175520 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.175529 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.175537 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.175590 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.178561 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.179510 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.179514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.179516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.179648 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.180165 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.180170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.180173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.180558 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.180724 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.181668 (+ 944us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.181884 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":259,"threads_started":1}
I20260619 04:45:02.183723 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.162865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41304 (local address 127.9.224.124:33747)
0619 04:45:02.164336 (+ 1471us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.164351 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.164398 (+ 47us) server_negotiation.cc:407] Connection header received
0619 04:45:02.166159 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.166182 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.166532 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.166735 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.168143 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.169533 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.170891 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.171646 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.171825 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.176390 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.176402 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.176421 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.176463 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.179888 (+ 3425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.180804 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.180812 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.180815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.180961 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.181327 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.181332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.181335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.181789 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.182093 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.182726 (+ 633us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.182993 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":1183,"thread_start_us":949,"threads_started":1}
I20260619 04:45:02.183753 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.163504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46509 (local address 127.0.0.1:35488)
0619 04:45:02.164520 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.164554 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:02.166181 (+ 1627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:02.166813 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:02.166819 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:02.167584 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:02.167963 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.167981 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.169049 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.169055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.170510 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.170522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.171397 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.171403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.171727 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.172747 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:02.172770 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:02.175275 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:02.178721 (+ 3446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.178732 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.178746 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.179368 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.179763 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.179771 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.179775 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.180036 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.180693 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:02.180699 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:02.181193 (+ 494us) client_negotiation.cc:769] Sending connection context
0619 04:45:02.181552 (+ 359us) client_negotiation.cc:240] Negotiation successful
0619 04:45:02.182096 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"mutex_wait_us":81,"thread_start_us":696,"threads_started":1}
I20260619 04:45:02.185581 32700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844302, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:45:02.201717 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.186472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:42055 (local address 127.0.0.1:47396)
0619 04:45:02.186807 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.186822 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:02.186964 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:02.187579 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:02.187585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:02.188073 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:02.188303 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.188317 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.189341 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.189345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.190473 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.190489 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.191190 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.191196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.191434 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.192113 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:02.192138 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:02.194841 (+ 2703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:02.199066 (+ 4225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.199070 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.199072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.199473 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.199911 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.199915 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.199917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.200056 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.200717 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:02.200723 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:02.200909 (+ 186us) client_negotiation.cc:769] Sending connection context
0619 04:45:02.201066 (+ 157us) client_negotiation.cc:240] Negotiation successful
0619 04:45:02.201361 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250}
I20260619 04:45:02.201722 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.186460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47396 (local address 127.9.224.125:42055)
0619 04:45:02.186700 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.186706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.186931 (+ 225us) server_negotiation.cc:407] Connection header received
0619 04:45:02.187104 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.187110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.187198 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.187329 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.188462 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.189197 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.190613 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.191039 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.191135 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.195032 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.195037 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.195040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.195074 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.198760 (+ 3686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.199616 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.199621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.199624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.199796 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.200178 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.200185 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.200189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.200586 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.200704 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.201198 (+ 494us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.201428 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 04:45:02.203367 32704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.187242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35496 (local address 127.9.224.126:46509)
0619 04:45:02.187421 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.187425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.187486 (+ 61us) server_negotiation.cc:407] Connection header received
0619 04:45:02.187654 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.187657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.187726 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.187800 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.189137 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.189918 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.191412 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.191973 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.192087 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.197165 (+ 5078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.197173 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.197179 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.197223 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.200400 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.201213 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.201218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.201221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.201384 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.201797 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.201803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.201807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.202177 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.202545 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.202829 (+ 284us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.203056 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:45:02.203368 32700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:02.211686 32551 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 4
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844302, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:45:02.220002 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.204201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41316)
0619 04:45:02.204462 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.204481 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:02.204623 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:02.204925 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:02.204929 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:02.205398 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:02.205575 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.205589 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.207037 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.207041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.208369 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.208385 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.209351 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.209355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.209517 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.210137 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:02.210159 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:02.212861 (+ 2702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:02.217014 (+ 4153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.217020 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.217024 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.217513 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.217920 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.217925 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.217932 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.218100 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.218734 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:02.218740 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:02.218933 (+ 193us) client_negotiation.cc:769] Sending connection context
0619 04:45:02.219104 (+ 171us) client_negotiation.cc:240] Negotiation successful
0619 04:45:02.219459 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260619 04:45:02.220072 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.204306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41316 (local address 127.9.224.124:33747)
0619 04:45:02.204463 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.204470 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.204560 (+ 90us) server_negotiation.cc:407] Connection header received
0619 04:45:02.204735 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.204741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.204814 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.204909 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.205718 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.206917 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.208507 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.209172 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.209322 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.213072 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.213080 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.213087 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.213130 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.216874 (+ 3744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.217641 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.217649 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.217653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.217787 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.218212 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.218216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.218219 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.218599 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.218755 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.219236 (+ 481us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.219686 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":158,"server-negotiator.queue_time_us":53}
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
I20260619 04:45:02.225708 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.205200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47412 (local address 127.9.224.125:42055)
0619 04:45:02.205391 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.205396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.205412 (+ 16us) server_negotiation.cc:407] Connection header received
0619 04:45:02.205457 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.205461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.205530 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.205635 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.207239 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.208305 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.209991 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.210768 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.210915 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.217481 (+ 6566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.217486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.217490 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.217524 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.221285 (+ 3761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.222288 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.222294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.222297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.222480 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.222999 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.223006 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.223011 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.223374 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.224953 (+ 1579us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.225093 (+ 140us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.225344 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:45:02.227180 32700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: Bootstrap starting.
I20260619 04:45:02.229724 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.212332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41326)
0619 04:45:02.212540 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.212561 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:02.212668 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:02.213847 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:02.213855 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:02.214421 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:02.214649 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.214663 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.216375 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.216379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.217791 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.217805 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.218836 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.218841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.218978 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.219612 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:02.219641 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:02.222191 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:02.226660 (+ 4469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.226673 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.226676 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.227090 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.227715 (+ 625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.227721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.227730 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.227916 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.228630 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:02.228635 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:02.228840 (+ 205us) client_negotiation.cc:769] Sending connection context
0619 04:45:02.228997 (+ 157us) client_negotiation.cc:240] Negotiation successful
0619 04:45:02.229312 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260619 04:45:02.229815 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.212870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41326 (local address 127.9.224.124:33747)
0619 04:45:02.213576 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.213579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.213600 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:45:02.213636 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.213638 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.213687 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.213812 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.214843 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.216223 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.217963 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.218661 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.219264 (+ 603us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.222462 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.222467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.222470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.222500 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.226461 (+ 3961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.227217 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.227224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.227227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.227556 (+ 329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.228049 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.228053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.228055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.228489 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.228658 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.229109 (+ 451us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.229345 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":422,"threads_started":1}
I20260619 04:45:02.231253 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:45:02.232159 32700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: Neither blocks nor log segments found. Creating new log.
I20260619 04:45:02.233289 32700 log.cc:824] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: Log is configured to *not* fsync() on all Append() calls
I20260619 04:45:02.236407 32551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531: Bootstrap starting.
I20260619 04:45:02.237151 32700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: No bootstrap required, opened a new log
I20260619 04:45:02.234970 32526 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7b65a5fadb2b46ad902fbff136046531"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35496
I20260619 04:45:02.240856 32551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531: Neither blocks nor log segments found. Creating new log.
I20260619 04:45:02.242267 32551 log.cc:824] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531: Log is configured to *not* fsync() on all Append() calls
I20260619 04:45:02.245893 32551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531: No bootstrap required, opened a new log
I20260619 04:45:02.247998 32700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.248456 32700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a5de236c0594860a196b61bf1f592bc, State: Initialized, Role: FOLLOWER
I20260619 04:45:02.248967 32700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.249989 32709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.250432 32709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.251298 32700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:45:02.253876 32551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.254347 32551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b65a5fadb2b46ad902fbff136046531, State: Initialized, Role: FOLLOWER
I20260619 04:45:02.254968 32551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.256125 32718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.256515 32718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.257858 32551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:45:02.257899 32526 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 04:45:02.258126 32526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:45:02.261121 32526 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.263597 32526 leader_election.cc:288] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [CANDIDATE]: Term 1 election: Requested vote from peers 3e631a1265eb4050b8ec38a6afc24013 (127.9.224.125:42055), 5a5de236c0594860a196b61bf1f592bc (127.9.224.124:33747)
I20260619 04:45:02.264490 32675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b65a5fadb2b46ad902fbff136046531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5a5de236c0594860a196b61bf1f592bc"
I20260619 04:45:02.265053 32675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:45:02.269680 32675 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b65a5fadb2b46ad902fbff136046531 in term 1.
I20260619 04:45:02.270877 32503 leader_election.cc:302] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a5de236c0594860a196b61bf1f592bc, 7b65a5fadb2b46ad902fbff136046531; no voters:
I20260619 04:45:02.271520 32718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:45:02.281605 32718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [term 1 LEADER]: Becoming Leader. State: Replica: 7b65a5fadb2b46ad902fbff136046531, State: Running, Role: LEADER
I20260619 04:45:02.282509 32718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
W20260619 04:45:02.285003 32726 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 04:45:02.285135 32726 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 04:45:02.275554 32633 master_runner.cc:186] Error getting master registration for 127.9.224.126:46509: OK, instance_id { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" instance_seqno: 1781844301068572 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 04:45:02.291762 32633 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 04:45:02.292207 32730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b65a5fadb2b46ad902fbff136046531. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.292670 32730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: This master's current role is: LEADER
I20260619 04:45:02.293810 32738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260619 04:45:02.307381 32505 tablet.cc:2369] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:45:02.309403 32738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:45:02.311558 32484 master_runner.cc:186] Error getting master registration for 127.9.224.125:42055: OK, instance_id { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" instance_seqno: 1781844301613212 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 04:45:02.334681 32484 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 04:45:02.345330 32625 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } attempt: 5
Jun 19 04:45:02 dist-test-slave-9dgf krb5kdc[32471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844301, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
I20260619 04:45:02.356617 32675 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [term 1 FOLLOWER]: Refusing update from remote peer 7b65a5fadb2b46ad902fbff136046531: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:45:02.358052 32718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:45:02.360993 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.310091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47422 (local address 127.9.224.125:42055)
0619 04:45:02.310339 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.310346 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.338406 (+ 28060us) server_negotiation.cc:407] Connection header received
0619 04:45:02.339471 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.339477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.339571 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.339644 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.343466 (+ 3822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.344665 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.346963 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.347728 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.347845 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.352536 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.352544 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.352551 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.352595 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.356690 (+ 4095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.357564 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.357570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.357574 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.357781 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.358318 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.358324 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.358327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.358959 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.359251 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.359887 (+ 636us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.360608 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 04:45:02.363492 32704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.311158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35502 (local address 127.9.224.126:46509)
0619 04:45:02.311473 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.311481 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.317522 (+ 6041us) server_negotiation.cc:407] Connection header received
0619 04:45:02.317721 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.317730 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.317852 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.318003 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.321571 (+ 3568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.323341 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.326727 (+ 3386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.327949 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.328122 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.333041 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.333052 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.333059 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.333164 (+ 105us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.339268 (+ 6104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.340820 (+ 1552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.340829 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.340833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.341099 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.341906 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.341912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.341915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.342661 (+ 746us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.343149 (+ 488us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.344235 (+ 1086us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.344689 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202}
I20260619 04:45:02.373366 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.345935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:33747 (local address 127.0.0.1:41336)
0619 04:45:02.346177 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:02.346195 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:02.346532 (+ 337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:02.346892 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:02.346898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:02.347416 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:02.347635 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.347647 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.349102 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.349107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.350567 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:02.350583 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.352023 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.352029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:02.352247 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.352914 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:02.352943 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:02.356219 (+ 3276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:02.364812 (+ 8593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.364817 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.364821 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.365814 (+ 993us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.366697 (+ 883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:02.366702 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:02.366706 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:02.367035 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:02.368334 (+ 1299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:02.368340 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:02.370377 (+ 2037us) client_negotiation.cc:769] Sending connection context
0619 04:45:02.370653 (+ 276us) client_negotiation.cc:240] Negotiation successful
0619 04:45:02.371617 (+ 964us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260619 04:45:02.377643 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.345995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41336 (local address 127.9.224.124:33747)
0619 04:45:02.346415 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.346424 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.346441 (+ 17us) server_negotiation.cc:407] Connection header received
0619 04:45:02.346671 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.346677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.346744 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.346841 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.347777 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.348935 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.350751 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.351602 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.351727 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.356385 (+ 4658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.356393 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.356397 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.356433 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.364522 (+ 8089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.366115 (+ 1593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.366120 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.366154 (+ 34us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.366492 (+ 338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.367282 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.367288 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.367293 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.368102 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.374418 (+ 6316us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.375453 (+ 1035us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.376234 (+ 781us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":282}
W20260619 04:45:02.381016 32654 tablet.cc:2369] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:45:02.385905 32625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: Bootstrap starting.
I20260619 04:45:02.395742 32709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b65a5fadb2b46ad902fbff136046531. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.396116 32709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.405308 32738 catalog_manager.cc:1347] Generated new cluster ID: 46ea0d3b450a40de807c31d4159778f9
I20260619 04:45:02.405452 32738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:45:02.406937 32718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.407279 32718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: This master's current role is: LEADER
I20260619 04:45:02.411157 32625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: Neither blocks nor log segments found. Creating new log.
I20260619 04:45:02.414428 32625 log.cc:824] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: Log is configured to *not* fsync() on all Append() calls
I20260619 04:45:02.432224 32625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: No bootstrap required, opened a new log
I20260619 04:45:02.440342 32709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.440891 32709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.447244 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.324884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41328 (local address 127.9.224.124:33747)
0619 04:45:02.325082 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.325088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.343506 (+ 18418us) server_negotiation.cc:407] Connection header received
0619 04:45:02.343776 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.343783 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.343899 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.343972 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.350745 (+ 6773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.352023 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.378269 (+ 26246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.386377 (+ 8108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.386518 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.427422 (+ 40904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:02.427430 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:02.427435 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:02.427487 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:02.431616 (+ 4129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.442278 (+ 10662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.442284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.442287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.442504 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:02.443186 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:02.443192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:02.443195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:02.443665 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:02.443962 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.446468 (+ 2506us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.446819 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":74}
I20260619 04:45:02.454336 32625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.455335 32625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e631a1265eb4050b8ec38a6afc24013, State: Initialized, Role: FOLLOWER
I20260619 04:45:02.456435 32625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } }
I20260619 04:45:02.467631 32738 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:45:02.470907 32751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.471374 32751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.473266 32738 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:45:02.474395 32599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:45:02.478101 32599 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [term 1 FOLLOWER]: Refusing update from remote peer 7b65a5fadb2b46ad902fbff136046531: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:45:02.478852 32600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b65a5fadb2b46ad902fbff136046531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3e631a1265eb4050b8ec38a6afc24013"
I20260619 04:45:02.482400 32600 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b65a5fadb2b46ad902fbff136046531 in term 1.
I20260619 04:45:02.484011 32718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:45:02.493176 32625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:45:02.501233 32738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531: Generated new TSK 0
I20260619 04:45:02.502470 32738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:45:02.535110 32751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b65a5fadb2b46ad902fbff136046531. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.535166 32730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.535457 32751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.535493 32730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b65a5fadb2b46ad902fbff136046531 [sys.catalog]: This master's current role is: LEADER
I20260619 04:45:02.535915 32756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b65a5fadb2b46ad902fbff136046531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b65a5fadb2b46ad902fbff136046531" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46509 } } peers { permanent_uuid: "3e631a1265eb4050b8ec38a6afc24013" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 42055 } } peers { permanent_uuid: "5a5de236c0594860a196b61bf1f592bc" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 33747 } } }
I20260619 04:45:02.536528 32756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:02.554651 32767 catalog_manager.cc:1259] Loaded cluster ID: 46ea0d3b450a40de807c31d4159778f9
I20260619 04:45:02.554777 32767 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: loading cluster ID for follower catalog manager: success
I20260619 04:45:02.570911 32767 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: acquiring CA information for follower catalog manager: success
I20260619 04:45:02.573760 32767 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3e631a1265eb4050b8ec38a6afc24013: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 04:45:02.676206 32704 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.659467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35504 (local address 127.9.224.126:46509)
0619 04:45:02.659683 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.659689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.672955 (+ 13266us) server_negotiation.cc:407] Connection header received
0619 04:45:02.674125 (+ 1170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.674133 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.674220 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.674327 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.675940 (+ 1613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35504: BlockingRecv error: recv got EOF from 127.0.0.1:35504 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260619 04:45:02.676283 32630 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.659133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47432 (local address 127.9.224.125:42055)
0619 04:45:02.659345 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.659352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.670681 (+ 11329us) server_negotiation.cc:407] Connection header received
0619 04:45:02.674510 (+ 3829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.674515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.674729 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.674825 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.675952 (+ 1127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47432: BlockingRecv error: recv got EOF from 127.0.0.1:47432 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260619 04:45:02.677779 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.667391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41352 (local address 127.9.224.124:33747)
0619 04:45:02.667587 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.667593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.673456 (+ 5863us) server_negotiation.cc:407] Connection header received
0619 04:45:02.674544 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.674551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.674630 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.674700 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.677526 (+ 2826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41352: BlockingRecv error: recv got EOF from 127.0.0.1:41352 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:45:02.727902 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.708692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47448 (local address 127.9.224.125:42055)
0619 04:45:02.708891 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.708898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.719920 (+ 11022us) server_negotiation.cc:407] Connection header received
0619 04:45:02.720270 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.720299 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.720507 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.720655 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:02.721420 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.722605 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.724758 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.725448 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.725566 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.726374 (+ 808us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:02.727068 (+ 694us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:02.727183 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.727441 (+ 258us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.727546 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260619 04:45:02.796857 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.788030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41362 (local address 127.9.224.124:33747)
0619 04:45:02.788262 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.788269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.794794 (+ 6525us) server_negotiation.cc:407] Connection header received
0619 04:45:02.795145 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.795152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.795302 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.795384 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.796592 (+ 1208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41362: BlockingRecv error: recv got EOF from 127.0.0.1:41362 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 04:45:02.851227 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.832404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47464 (local address 127.9.224.125:42055)
0619 04:45:02.832627 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.832633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.843579 (+ 10946us) server_negotiation.cc:407] Connection header received
0619 04:45:02.844340 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.844347 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.844472 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.844555 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:02.845382 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.846588 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.848731 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.849495 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.849597 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.850295 (+ 698us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:02.850469 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:02.850541 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.850803 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.850900 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260619 04:45:02.909129 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.899503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41372 (local address 127.9.224.124:33747)
0619 04:45:02.899740 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.899746 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.906989 (+ 7243us) server_negotiation.cc:407] Connection header received
0619 04:45:02.907544 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.907552 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.907653 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.907734 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.908878 (+ 1144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41372: BlockingRecv error: recv got EOF from 127.0.0.1:41372 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:45:02.947438 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.940087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47470 (local address 127.9.224.125:42055)
0619 04:45:02.940320 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.940329 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.940910 (+ 581us) server_negotiation.cc:407] Connection header received
0619 04:45:02.941131 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.941137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.941225 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.941319 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:02.942033 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.943108 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.945067 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.945726 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.945849 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.946494 (+ 645us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:02.946680 (+ 186us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:02.946758 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.946983 (+ 225us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.947065 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260619 04:45:02.967140 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.964535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41384 (local address 127.9.224.124:33747)
0619 04:45:02.964750 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.964757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.965449 (+ 692us) server_negotiation.cc:407] Connection header received
0619 04:45:02.965678 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.965684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.965794 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.965910 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.966915 (+ 1005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41384: BlockingRecv error: recv got EOF from 127.0.0.1:41384 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 04:45:02.987711 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:02.980350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47482 (local address 127.9.224.125:42055)
0619 04:45:02.980668 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.980674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.981241 (+ 567us) server_negotiation.cc:407] Connection header received
0619 04:45:02.981487 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.981493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.981582 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.981678 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:02.982216 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.983432 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.985499 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:02.986194 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:02.986392 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:02.986915 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:02.987046 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:02.987163 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:02.987330 (+ 167us) server_negotiation.cc:299] Negotiation successful
0619 04:45:02.987415 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
W20260619 04:45:02.999850 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:02.995752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41400 (local address 127.9.224.124:33747)
0619 04:45:02.995986 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:02.995992 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:02.998016 (+ 2024us) server_negotiation.cc:407] Connection header received
0619 04:45:02.998340 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:02.998346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:02.998469 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:02.998549 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:02.999572 (+ 1023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41400: BlockingRecv error: recv got EOF from 127.0.0.1:41400 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
I20260619 04:45:03.020287 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.012232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47492 (local address 127.9.224.125:42055)
0619 04:45:03.012472 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.012479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.013052 (+ 573us) server_negotiation.cc:407] Connection header received
0619 04:45:03.013387 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.013396 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.013496 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.013567 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.014336 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.015516 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.017536 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.018314 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.018420 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.019101 (+ 681us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.019276 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.019343 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.019588 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.019685 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260619 04:45:03.037292 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:03.028421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41414 (local address 127.9.224.124:33747)
0619 04:45:03.028631 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.028638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.034621 (+ 5983us) server_negotiation.cc:407] Connection header received
0619 04:45:03.034979 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.034987 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.035126 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.035211 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:03.037054 (+ 1843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41414: BlockingRecv error: recv got EOF from 127.0.0.1:41414 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 04:45:03.062623 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.057137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47494 (local address 127.9.224.125:42055)
0619 04:45:03.057330 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.057337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.057671 (+ 334us) server_negotiation.cc:407] Connection header received
0619 04:45:03.057895 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.057899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.057970 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.058064 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.058557 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.059526 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.060842 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.061282 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.061425 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.061882 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.061985 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.062092 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.062260 (+ 168us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.062348 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260619 04:45:03.072582 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:03.069807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41424 (local address 127.9.224.124:33747)
0619 04:45:03.070029 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.070035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.070851 (+ 816us) server_negotiation.cc:407] Connection header received
0619 04:45:03.071051 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.071057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.071186 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.071313 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:03.072317 (+ 1004us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41424: BlockingRecv error: recv got EOF from 127.0.0.1:41424 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:45:03.113745 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.108134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47500 (local address 127.9.224.125:42055)
0619 04:45:03.108406 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.108414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.108790 (+ 376us) server_negotiation.cc:407] Connection header received
0619 04:45:03.109013 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.109018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.109135 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.109238 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.109667 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.110476 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.111997 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.112450 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.112594 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.112976 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.113095 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.113193 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.113351 (+ 158us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.113435 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260619 04:45:03.121634 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:03.119585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41440 (local address 127.9.224.124:33747)
0619 04:45:03.119831 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.119837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.120137 (+ 300us) server_negotiation.cc:407] Connection header received
0619 04:45:03.120384 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.120388 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.120459 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.120549 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:03.121382 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41440: BlockingRecv error: recv got EOF from 127.0.0.1:41440 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:45:03.194119 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.189226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47514 (local address 127.9.224.125:42055)
0619 04:45:03.189412 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.189416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.189773 (+ 357us) server_negotiation.cc:407] Connection header received
0619 04:45:03.189953 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.189957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.190031 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.190120 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.190527 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.191270 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.192554 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.193010 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.193151 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.193551 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.193658 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.193727 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.193850 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.193916 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260619 04:45:03.201685 32706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:03.199824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41456 (local address 127.9.224.124:33747)
0619 04:45:03.200051 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.200059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.200337 (+ 278us) server_negotiation.cc:407] Connection header received
0619 04:45:03.200557 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.200562 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.200633 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.200741 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:03.201503 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41456: BlockingRecv error: recv got EOF from 127.0.0.1:41456 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 04:45:03.287321 32726 catalog_manager.cc:1259] Loaded cluster ID: 46ea0d3b450a40de807c31d4159778f9
I20260619 04:45:03.287424 32726 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: loading cluster ID for follower catalog manager: success
I20260619 04:45:03.289783 32726 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: acquiring CA information for follower catalog manager: success
I20260619 04:45:03.291639 32726 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5a5de236c0594860a196b61bf1f592bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 04:45:03.338265 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.333232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47530 (local address 127.9.224.125:42055)
0619 04:45:03.333413 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.333417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.333792 (+ 375us) server_negotiation.cc:407] Connection header received
0619 04:45:03.333961 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.333965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.334044 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.334137 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.334574 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.335253 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.336622 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.337104 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.337229 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.337606 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.337720 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.337789 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.337931 (+ 142us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.337995 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 04:45:03.349871 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.343949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41472 (local address 127.9.224.124:33747)
0619 04:45:03.344173 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.344181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.344526 (+ 345us) server_negotiation.cc:407] Connection header received
0619 04:45:03.344742 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.344748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.344929 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.345054 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.345447 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.346199 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.347557 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.348012 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.348158 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.348678 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.349215 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.349381 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.349493 (+ 112us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.349582 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:45:03.370676 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.356265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47536 (local address 127.9.224.125:42055)
0619 04:45:03.356444 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.356451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.364339 (+ 7888us) server_negotiation.cc:407] Connection header received
0619 04:45:03.364602 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.364608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.364690 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.364802 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.365391 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.366524 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.368733 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.369168 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.369322 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.369822 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.369956 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.370020 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.370275 (+ 255us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.370365 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 04:45:03.371528 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.356705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35518 (local address 127.9.224.126:46509)
0619 04:45:03.364536 (+ 7831us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.364545 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.364575 (+ 30us) server_negotiation.cc:407] Connection header received
0619 04:45:03.364733 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.364742 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.365019 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.365255 (+ 236us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.365957 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.367099 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.368859 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.369503 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.369637 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.370187 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.370669 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.371053 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.371109 (+ 56us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.371202 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7650,"thread_start_us":7514,"threads_started":1}
I20260619 04:45:03.372505 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:03.356451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41480 (local address 127.9.224.124:33747)
0619 04:45:03.357970 (+ 1519us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:03.357979 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:03.366097 (+ 8118us) server_negotiation.cc:407] Connection header received
0619 04:45:03.366258 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:03.366264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:03.366349 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:03.366444 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:03.367136 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.368271 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.370313 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:03.370936 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:03.371021 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:03.371667 (+ 646us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:03.371836 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:03.371926 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:03.372122 (+ 196us) server_negotiation.cc:299] Negotiation successful
0619 04:45:03.372208 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1357}
I20260619 04:45:03.377113 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32484
I20260619 04:45:03.378190 32546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:45:03.488826 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32484
I20260619 04:45:03.509701 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32558
I20260619 04:45:03.510919 32620 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:45:03.619130 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32558
I20260619 04:45:03.639623 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 32633
I20260619 04:45:03.641022 32695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:45:03.749001 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 32633
2026-06-19T04:45:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4508 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 04:45:03 dist-test-slave-9dgf krb5kdc[413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 04:45:03 dist-test-slave-9dgf krb5kdc[413](info): set up 2 sockets
Jun 19 04:45:03 dist-test-slave-9dgf krb5kdc[413](info): commencing operation
krb5kdc: starting...
W20260619 04:45:04.878804 10113 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.006s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/test-user.keytab.
Jun 19 04:45:05 dist-test-slave-9dgf krb5kdc[413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T04:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T04:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.224.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
Entry for principal kudu/127.9.224.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab.
I20260619 04:45:05.149712 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46375
--webserver_interface=127.9.224.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46375,127.9.224.125:37413,127.9.224.124:40597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 04:45:05.489929 426 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 04:45:05.490365 426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:45:05.490489 426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:45:05.490620 426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:45:05.498163 426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:45:05.498327 426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:45:05.498432 426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:45:05.498504 426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:45:05.498590 426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:45:05.508575 426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46375,127.9.224.125:37413,127.9.224.124:40597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.126.keytab
--principal=kudu/127.9.224.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.126:46375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.224.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:45:05.510012 426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:45:05.511430 426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:45:05.523437 432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:05.523509 434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:05.523463 431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:45:05.524391 426 server_base.cc:1034] running on GCE node
I20260619 04:45:05.525259 426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:45:05.526785 426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:45:05.528076 426 hybrid_clock.cc:648] HybridClock initialized: now 1781844305528006 us; error 38 us; skew 500 ppm
I20260619 04:45:05.528458 426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:45:05 dist-test-slave-9dgf krb5kdc[413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:45:05.532224 426 init.cc:377] Logged in from keytab as kudu/127.9.224.126@KRBTEST.COM (short username kudu)
I20260619 04:45:05.533828 426 webserver.cc:460] Webserver started at http://127.9.224.126:34445/ using document root <none> and password file <none>
I20260619 04:45:05.534684 426 fs_manager.cc:359] Metadata directory not provided
I20260619 04:45:05.534823 426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:45:05.535173 426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:45:05.538389 426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data/instance:
uuid: "705552ccefaa4f79958ade95b00196cc"
format_stamp: "Formatted at 2026-06-19 04:45:05 on dist-test-slave-9dgf"
server_key: "8865d4cb88aeb90a9196efcc63177d5f"
server_key_iv: "ca6b7176e80f6a70cc1bfe63e071e4de"
server_key_version: "encryptionkey@0"
I20260619 04:45:05.539280 426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal/instance:
uuid: "705552ccefaa4f79958ade95b00196cc"
format_stamp: "Formatted at 2026-06-19 04:45:05 on dist-test-slave-9dgf"
server_key: "8865d4cb88aeb90a9196efcc63177d5f"
server_key_iv: "ca6b7176e80f6a70cc1bfe63e071e4de"
server_key_version: "encryptionkey@0"
I20260619 04:45:05.545051 426 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 04:45:05.548936 441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:45:05.550523 426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 04:45:05.550721 426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal
uuid: "705552ccefaa4f79958ade95b00196cc"
format_stamp: "Formatted at 2026-06-19 04:45:05 on dist-test-slave-9dgf"
server_key: "8865d4cb88aeb90a9196efcc63177d5f"
server_key_iv: "ca6b7176e80f6a70cc1bfe63e071e4de"
server_key_version: "encryptionkey@0"
I20260619 04:45:05.550964 426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:45:05.567220 426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:45:05.571671 426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:45:05.571969 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:45:05.590857 426 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.126:46375
I20260619 04:45:05.590864 492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.126:46375 every 8 connection(s)
I20260619 04:45:05.592283 426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/data/info.pb
I20260619 04:45:05.595897 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 426
I20260619 04:45:05.596091 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-0/wal/instance
I20260619 04:45:05.596366 493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:45:05.596680 10113 external_mini_cluster.cc:1428] Setting key a24ffee1a2849320bbbcc5e6493d5775
I20260619 04:45:05.606837 493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:05 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.125@KRBTEST.COM" created.
I20260619 04:45:05.633215 497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.610753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.9.224.126:46375)
0619 04:45:05.612540 (+ 1787us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:05.612551 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:05.612612 (+ 61us) server_negotiation.cc:407] Connection header received
0619 04:45:05.614339 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:05.614351 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:05.614706 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:05.614927 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:05.616115 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:05.618118 (+ 2003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:05.619683 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:05.620710 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:05.620941 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:05.625218 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:05.625231 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:05.625249 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:05.625287 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:05.628526 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:05.629375 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:05.629383 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:05.629385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:05.629537 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:05.630093 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:05.630097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:05.630099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:05.630768 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:05.630942 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:05.631715 (+ 773us) server_negotiation.cc:299] Negotiation successful
0619 04:45:05.631979 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1554,"spinlock_wait_cycles":35200,"thread_start_us":1334,"threads_started":1}
I20260619 04:45:05.633276 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.610753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46375 (local address 127.0.0.1:45568)
0619 04:45:05.611817 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.611899 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:05.613876 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:05.614964 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:05.614969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:05.615547 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:05.615888 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:05.615905 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:05.618383 (+ 2478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:05.618387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:05.619528 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:05.619541 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:05.620974 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:05.620980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:05.621184 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:05.622009 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:05.622047 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:05.624945 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:05.628652 (+ 3707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:05.628663 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:05.628673 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:05.629184 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:05.629674 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:05.629682 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:05.629688 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:05.629940 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:05.630952 (+ 1012us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:05.630962 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:05.631242 (+ 280us) client_negotiation.cc:769] Sending connection context
0619 04:45:05.631527 (+ 285us) client_negotiation.cc:240] Negotiation successful
0619 04:45:05.632215 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"mutex_wait_us":99,"thread_start_us":415,"threads_started":1}
I20260619 04:45:05.636343 493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:05.637535 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.637014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:57968)
0619 04:45:05.637218 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.637362 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260619 04:45:05.637823 442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
I20260619 04:45:05.639569 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.639077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:57980)
0619 04:45:05.639295 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.639402 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260619 04:45:05.639794 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:37413: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab.
Entry for principal kudu/127.9.224.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab.
I20260619 04:45:05.661607 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:37413
--webserver_interface=127.9.224.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab
--principal=kudu/127.9.224.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46375,127.9.224.125:37413,127.9.224.124:40597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:45:05.689148 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } attempt: 1
I20260619 04:45:05.690493 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.689932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:57996)
0619 04:45:05.690189 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.690353 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 04:45:05.691509 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.691162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58000)
0619 04:45:05.691302 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.691377 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260619 04:45:05.691744 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:37413: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
I20260619 04:45:05.760006 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } attempt: 2
I20260619 04:45:05.761396 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.760839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58016)
0619 04:45:05.761091 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.761239 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 04:45:05.762601 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.762138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58030)
0619 04:45:05.762313 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.762421 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260619 04:45:05.762768 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:37413: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
I20260619 04:45:05.854101 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } attempt: 3
I20260619 04:45:05.855468 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.854943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58032)
0619 04:45:05.855168 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.855284 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260619 04:45:05.856670 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:05.856176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58034)
0619 04:45:05.856382 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:05.856492 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260619 04:45:05.856885 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:37413: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
I20260619 04:45:06.000193 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } attempt: 4
I20260619 04:45:06.001652 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.001056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58044)
0619 04:45:06.001391 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.001488 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
I20260619 04:45:06.002853 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.002409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58054)
0619 04:45:06.002587 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.002688 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260619 04:45:06.003120 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.125:37413: Network error: Client connection negotiation failed: client connection to 127.9.224.125:37413: connect: Connection refused (error 111)
W20260619 04:45:06.010825 500 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 04:45:06.011255 500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:45:06.011334 500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:45:06.011423 500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:45:06.019660 500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:45:06.019765 500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:45:06.019825 500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:45:06.019876 500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:45:06.019937 500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:45:06.030164 500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46375,127.9.224.125:37413,127.9.224.124:40597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.125.keytab
--principal=kudu/127.9.224.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.125:37413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.224.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:45:06.031543 500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:45:06.032895 500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:45:06.045389 506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:06.045343 508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:06.045420 505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:45:06.046342 500 server_base.cc:1034] running on GCE node
I20260619 04:45:06.047230 500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:45:06.048800 500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:45:06.050040 500 hybrid_clock.cc:648] HybridClock initialized: now 1781844306049961 us; error 57 us; skew 500 ppm
I20260619 04:45:06.050437 500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:45:06.053555 500 init.cc:377] Logged in from keytab as kudu/127.9.224.125@KRBTEST.COM (short username kudu)
I20260619 04:45:06.055186 500 webserver.cc:460] Webserver started at http://127.9.224.125:38365/ using document root <none> and password file <none>
I20260619 04:45:06.055981 500 fs_manager.cc:359] Metadata directory not provided
I20260619 04:45:06.056070 500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:45:06.056335 500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:45:06.059365 500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data/instance:
uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc"
format_stamp: "Formatted at 2026-06-19 04:45:06 on dist-test-slave-9dgf"
server_key: "fda5a965f31c5118707d361f98e227ee"
server_key_iv: "67de0d57b99907e040b15d4e534da285"
server_key_version: "encryptionkey@0"
I20260619 04:45:06.060096 500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal/instance:
uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc"
format_stamp: "Formatted at 2026-06-19 04:45:06 on dist-test-slave-9dgf"
server_key: "fda5a965f31c5118707d361f98e227ee"
server_key_iv: "67de0d57b99907e040b15d4e534da285"
server_key_version: "encryptionkey@0"
I20260619 04:45:06.065052 500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260619 04:45:06.068517 515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:45:06.069845 500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 04:45:06.069977 500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal
uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc"
format_stamp: "Formatted at 2026-06-19 04:45:06 on dist-test-slave-9dgf"
server_key: "fda5a965f31c5118707d361f98e227ee"
server_key_iv: "67de0d57b99907e040b15d4e534da285"
server_key_version: "encryptionkey@0"
I20260619 04:45:06.070150 500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:45:06.099870 500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:45:06.104076 500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:45:06.104311 500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:45:06.123660 500 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.125:37413
I20260619 04:45:06.123751 566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.125:37413 every 8 connection(s)
I20260619 04:45:06.125036 500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/data/info.pb
I20260619 04:45:06.128738 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 500
I20260619 04:45:06.128943 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-1/wal/instance
I20260619 04:45:06.129194 567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:45:06.129422 10113 external_mini_cluster.cc:1428] Setting key d78f834fd9367b325a571c35b2c80dc4
I20260619 04:45:06.136662 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.224.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.224.124@KRBTEST.COM" created.
I20260619 04:45:06.161229 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.139622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45580 (local address 127.9.224.126:46375)
0619 04:45:06.140211 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.140219 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.141329 (+ 1110us) server_negotiation.cc:407] Connection header received
0619 04:45:06.143587 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.143596 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.143700 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.143849 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.145686 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.147000 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.148922 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.149362 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.149514 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.153403 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.153409 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.153413 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.153498 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.157464 (+ 3966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.158396 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.158405 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.158411 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.158578 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.159018 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.159026 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.159031 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.159430 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.159584 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.160466 (+ 882us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.160724 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":288,"threads_started":1}
I20260619 04:45:06.162053 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.140263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46375 (local address 127.0.0.1:45580)
0619 04:45:06.141119 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.141188 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.143267 (+ 2079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.144095 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.144105 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.144810 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.145440 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.145459 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.147267 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.147273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.148751 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.148765 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.149614 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.149633 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.149871 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.150657 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.150686 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.153137 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.157680 (+ 4543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.157688 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.157703 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.158175 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.158695 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.158698 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.158701 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.158893 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.159632 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.159640 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.160014 (+ 374us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.160330 (+ 316us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.160789 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":357,"threads_started":1}
I20260619 04:45:06.164041 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:45:06.180678 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.164675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58060)
0619 04:45:06.164861 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.164883 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.165003 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.166167 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.166178 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.166731 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.166958 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.166973 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.168333 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.168341 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.169852 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.169868 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.170772 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.170781 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.171009 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.171642 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.171669 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.174461 (+ 2792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.177895 (+ 3434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.177900 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.177907 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.178462 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.178895 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.178900 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.178904 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.179051 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.179669 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.179675 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.179811 (+ 136us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.179958 (+ 147us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.180265 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260619 04:45:06.180769 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.165026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58060 (local address 127.9.224.125:37413)
0619 04:45:06.165731 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.165736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.165762 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:45:06.165806 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.165814 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.166000 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.166117 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.167134 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.168192 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.169992 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.170610 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.170707 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.174684 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.174696 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.174710 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.174738 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.177731 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.178596 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.178608 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.178616 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.178732 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.179162 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.179167 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.179170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.179533 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.179756 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.180112 (+ 356us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.180395 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":539,"thread_start_us":385,"threads_started":1}
I20260619 04:45:06.183189 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:06.184558 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.183967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58766)
0619 04:45:06.184139 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.184326 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 04:45:06.184844 518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.186503 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.186068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58770)
0619 04:45:06.186225 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.186381 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 04:45:06.186746 567 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.224.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab.
Entry for principal kudu/127.9.224.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab.
I20260619 04:45:06.191454 10113 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
/tmp/dist-test-taskXgzdm0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:40597
--webserver_interface=127.9.224.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab
--principal=kudu/127.9.224.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.224.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.224.126:46375,127.9.224.125:37413,127.9.224.124:40597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 04:45:06.236114 567 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 1
I20260619 04:45:06.237376 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.236928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58786)
0619 04:45:06.237115 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.237220 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260619 04:45:06.238461 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.238054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58788)
0619 04:45:06.238265 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.238357 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:45:06.238664 567 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.302423 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } attempt: 5
I20260619 04:45:06.306895 567 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 2
I20260619 04:45:06.307909 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.307450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58804)
0619 04:45:06.307640 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.307737 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260619 04:45:06.309101 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.308719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58818)
0619 04:45:06.308865 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.308960 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 04:45:06.310299 567 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:45:06.317556 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.303204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58068)
0619 04:45:06.303422 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.303446 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.303560 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.303963 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.303966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.304362 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.304541 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.304550 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.305931 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.305935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.306897 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.306912 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.308063 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.308069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.308334 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.309023 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.309046 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.311286 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.315096 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.315101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.315104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.315604 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.315983 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.315986 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.315989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.316117 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.316769 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.316773 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.316918 (+ 145us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.317047 (+ 129us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.317308 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260619 04:45:06.317775 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.303324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.9.224.125:37413)
0619 04:45:06.303519 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.303525 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.303550 (+ 25us) server_negotiation.cc:407] Connection header received
0619 04:45:06.303709 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.303714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.303799 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.303923 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.304695 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.305776 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.307076 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.307882 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.308016 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.311556 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.311563 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.311567 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.311608 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.314957 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.315719 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.315725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.315728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.315874 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.316219 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.316224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.316234 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.316618 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.316769 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.317251 (+ 482us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.317485 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 04:45:06.318957 493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:06.320034 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.319632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58822)
0619 04:45:06.319806 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.319900 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260619 04:45:06.321060 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.320722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58826)
0619 04:45:06.320871 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.320959 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:45:06.321329 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.372614 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 1
I20260619 04:45:06.373988 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.373419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58834)
0619 04:45:06.373610 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.373746 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260619 04:45:06.375114 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.374776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58850)
0619 04:45:06.374915 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.375007 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 04:45:06.375361 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.401580 567 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 3
I20260619 04:45:06.402840 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.402347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58860)
0619 04:45:06.402581 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.402678 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 04:45:06.404058 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.403629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58866)
0619 04:45:06.403872 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.403951 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260619 04:45:06.404366 567 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.443600 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 2
I20260619 04:45:06.444999 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.444363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58876)
0619 04:45:06.444654 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.444784 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260619 04:45:06.446089 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.445682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58888)
0619 04:45:06.445860 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.445951 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 04:45:06.446358 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
W20260619 04:45:06.533772 575 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 04:45:06.534165 575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 04:45:06.534351 575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 04:45:06.534502 575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 04:45:06.542057 575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 04:45:06.542272 575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 04:45:06.542393 575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 04:45:06.542472 575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 04:45:06.542583 575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 04:45:06.547591 567 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 4
I20260619 04:45:06.548929 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.548292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58900)
0619 04:45:06.548608 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.548722 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260619 04:45:06.549892 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.549569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58904)
0619 04:45:06.549712 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.549789 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 04:45:06.550097 567 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.552579 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 3
I20260619 04:45:06.553591 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.553128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58916)
0619 04:45:06.553316 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.553413 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260619 04:45:06.553996 575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.224.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.224.126:46375,127.9.224.125:37413,127.9.224.124:40597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/krb5kdc/kudu_127.9.224.124.keytab
--principal=kudu/127.9.224.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.224.124:40597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.224.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 03:14:01 UTC on ccycloud.quasar-sbacxj.root.comops.site
build id 4454981
ASAN enabled
I20260619 04:45:06.554797 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.554276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58928)
0619 04:45:06.554524 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.554634 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260619 04:45:06.555007 493 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.224.124:40597: Network error: Client connection negotiation failed: client connection to 127.9.224.124:40597: connect: Connection refused (error 111)
I20260619 04:45:06.555888 575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 04:45:06.557191 575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 04:45:06.569221 583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:06.569346 581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 04:45:06.569312 580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 04:45:06.570385 575 server_base.cc:1034] running on GCE node
I20260619 04:45:06.571161 575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 04:45:06.572615 575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 04:45:06.573872 575 hybrid_clock.cc:648] HybridClock initialized: now 1781844306573804 us; error 39 us; skew 500 ppm
I20260619 04:45:06.574407 575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 04:45:06.577760 575 init.cc:377] Logged in from keytab as kudu/127.9.224.124@KRBTEST.COM (short username kudu)
I20260619 04:45:06.579329 575 webserver.cc:460] Webserver started at http://127.9.224.124:42107/ using document root <none> and password file <none>
I20260619 04:45:06.580049 575 fs_manager.cc:359] Metadata directory not provided
I20260619 04:45:06.580183 575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 04:45:06.580514 575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 04:45:06.583715 575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data/instance:
uuid: "7444b5f60fee4c069a02c5f52f23e3a1"
format_stamp: "Formatted at 2026-06-19 04:45:06 on dist-test-slave-9dgf"
server_key: "8f408b77ce5315ba35161a0b9653938c"
server_key_iv: "758c01203487336c4c00e4845a7b993a"
server_key_version: "encryptionkey@0"
I20260619 04:45:06.584525 575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal/instance:
uuid: "7444b5f60fee4c069a02c5f52f23e3a1"
format_stamp: "Formatted at 2026-06-19 04:45:06 on dist-test-slave-9dgf"
server_key: "8f408b77ce5315ba35161a0b9653938c"
server_key_iv: "758c01203487336c4c00e4845a7b993a"
server_key_version: "encryptionkey@0"
I20260619 04:45:06.589831 575 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 04:45:06.593497 590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 04:45:06.595114 575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 04:45:06.595301 575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data,/tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal
uuid: "7444b5f60fee4c069a02c5f52f23e3a1"
format_stamp: "Formatted at 2026-06-19 04:45:06 on dist-test-slave-9dgf"
server_key: "8f408b77ce5315ba35161a0b9653938c"
server_key_iv: "758c01203487336c4c00e4845a7b993a"
server_key_version: "encryptionkey@0"
I20260619 04:45:06.595530 575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 04:45:06.634620 575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 04:45:06.639146 575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 04:45:06.639443 575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 04:45:06.659083 575 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.124:40597
I20260619 04:45:06.659101 641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.224.124:40597 every 8 connection(s)
I20260619 04:45:06.660480 575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/data/info.pb
I20260619 04:45:06.664471 642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 04:45:06.667802 10113 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu as pid 575
I20260619 04:45:06.668008 10113 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXgzdm0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781843940819459-10113-0/minicluster-data/master-2/wal/instance
I20260619 04:45:06.668450 10113 external_mini_cluster.cc:1428] Setting key a56aa15de4793f901f3c3021bc79b9a6
I20260619 04:45:06.672220 642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:45:06.691567 646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.675993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45584 (local address 127.9.224.126:46375)
0619 04:45:06.676485 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.676493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.676981 (+ 488us) server_negotiation.cc:407] Connection header received
0619 04:45:06.677191 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.677197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.677279 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.677390 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.678859 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.679762 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.681526 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.681929 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.682022 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.685872 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.685877 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.685880 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.685920 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.688465 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.689259 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.689263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.689265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.689410 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.689816 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.689821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.689824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.690128 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.690302 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.690912 (+ 610us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.691133 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":255,"threads_started":1}
I20260619 04:45:06.692715 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.670386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58936 (local address 127.9.224.124:40597)
0619 04:45:06.671198 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.671214 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.671266 (+ 52us) server_negotiation.cc:407] Connection header received
0619 04:45:06.673209 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.673243 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.673895 (+ 652us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.674382 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.675773 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.677649 (+ 1876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.679372 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.680312 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.680447 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.685447 (+ 5000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.685458 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.685479 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.685522 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.688568 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.689221 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.689230 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.689233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.689387 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.689771 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.689779 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.689785 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.690393 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.690702 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.690926 (+ 224us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.691231 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":337,"threads_started":1}
I20260619 04:45:06.692747 647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.676034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.126:46375 (local address 127.0.0.1:45584)
0619 04:45:06.676835 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.676880 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.677062 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.677453 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.677460 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.678364 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.678678 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.678691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.679925 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.679929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.681362 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.681382 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.682178 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.682186 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.682409 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.683055 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.683086 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.685682 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.688586 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.688597 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.688613 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.689119 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.689542 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.689545 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.689547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.689687 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.690281 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.690290 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.690494 (+ 204us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.690789 (+ 295us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.691355 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":137,"thread_start_us":450,"threads_started":1}
I20260619 04:45:06.694420 642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.126@KRBTEST.COM
I20260619 04:45:06.708031 647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.695074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.125:37413 (local address 127.0.0.1:58070)
0619 04:45:06.695235 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.695255 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.695373 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.695712 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.695717 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.696198 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.696355 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.696363 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.697322 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.697330 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.698195 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.698205 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.698943 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.698969 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.699197 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.699786 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.699814 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.701864 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.705361 (+ 3497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.705367 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.705372 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.705773 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.706194 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.706201 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.706205 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.706422 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.706978 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.706983 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.707160 (+ 177us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.707314 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.707621 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 04:45:06.708073 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.695201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.9.224.125:37413)
0619 04:45:06.695389 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.695397 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.695416 (+ 19us) server_negotiation.cc:407] Connection header received
0619 04:45:06.695476 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.695483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.695560 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.695686 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.696494 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.697189 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.698358 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.698787 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.698937 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.702053 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.702066 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.702069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.702101 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.705202 (+ 3101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.705911 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.705919 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.705923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.706069 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.706544 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.706551 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.706555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.706848 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.707020 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.707413 (+ 393us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.707667 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:45:06.709154 642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } has no permanent_uuid. Determining permanent_uuid...
I20260619 04:45:06.710938 646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.696130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45596 (local address 127.9.224.126:46375)
0619 04:45:06.696486 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.696490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.696503 (+ 13us) server_negotiation.cc:407] Connection header received
0619 04:45:06.696547 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.696550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.696605 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.696705 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.697807 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.698541 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.700109 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.700537 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.700673 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.704969 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.704975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.704979 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.705010 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.707655 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.708465 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.708471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.708474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.708655 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.709183 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.709188 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.709192 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.709566 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.709883 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.710276 (+ 393us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.710553 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.124@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.224.125@KRBTEST.COM
I20260619 04:45:06.723086 647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.710094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58940)
0619 04:45:06.710310 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.710331 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.710432 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.710847 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.710851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.711315 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.711445 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.711453 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.712548 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.712555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.713895 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.713911 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.714697 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.714703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.714916 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.715491 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.715506 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.717739 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.720739 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.720747 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.720754 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.721145 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.721571 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.721574 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.721576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.721704 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.722331 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.722334 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.722454 (+ 120us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.722584 (+ 130us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.722817 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260619 04:45:06.723606 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.710423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58940 (local address 127.9.224.124:40597)
0619 04:45:06.710567 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.710573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.710591 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:45:06.710640 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.710644 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.710715 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.710822 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.711571 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.712358 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.714038 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.714536 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.714637 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.717966 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.717975 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.717980 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.718015 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.720590 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.721273 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.721282 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.721287 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.721450 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.721816 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.721821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.721825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.722189 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.722380 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.722712 (+ 332us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.722996 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":53}
I20260619 04:45:06.728155 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.712945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.9.224.125:37413)
0619 04:45:06.713102 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.713106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.713120 (+ 14us) server_negotiation.cc:407] Connection header received
0619 04:45:06.713159 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.713162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.713211 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.713284 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.714825 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.715690 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.717258 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.717726 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.717824 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.722459 (+ 4635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.722464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.722467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.722498 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.725496 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.726305 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.726317 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.726320 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.726452 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.726856 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.726859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.726861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.727102 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.727295 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.727661 (+ 366us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.727845 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 04:45:06.729768 642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: Bootstrap starting.
I20260619 04:45:06.732215 493 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 4
I20260619 04:45:06.733140 10113 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 04:45:06.733897 642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: Neither blocks nor log segments found. Creating new log.
I20260619 04:45:06.735400 642 log.cc:824] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: Log is configured to *not* fsync() on all Append() calls
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844305, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.126@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
I20260619 04:45:06.736524 468 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "705552ccefaa4f79958ade95b00196cc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45596
I20260619 04:45:06.743034 642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: No bootstrap required, opened a new log
I20260619 04:45:06.749740 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.732839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58950 (local address 127.9.224.124:40597)
0619 04:45:06.733174 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.733180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.733198 (+ 18us) server_negotiation.cc:407] Connection header received
0619 04:45:06.733265 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.733269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.733342 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.733439 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.734216 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.734997 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.736668 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.737406 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.737534 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.742532 (+ 4998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.742539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.742543 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.742582 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.746788 (+ 4206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.747549 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.747555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.747558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.747704 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.748108 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.748114 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.748117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.748481 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.748662 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.749088 (+ 426us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.749358 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260619 04:45:06.749737 496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.732772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58950)
0619 04:45:06.733041 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.733062 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.733166 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.733470 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.733477 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.733889 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.734074 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.734083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.735143 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.735150 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.736484 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.736502 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.737601 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.737614 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.737953 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.738813 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.738853 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.742259 (+ 3406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.746978 (+ 4719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.746985 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.746989 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.747410 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.747835 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.747840 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.747843 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.747995 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.748625 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.748631 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.748805 (+ 174us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.748977 (+ 172us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.749292 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260619 04:45:06.753638 642 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.754050 642 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444b5f60fee4c069a02c5f52f23e3a1, State: Initialized, Role: FOLLOWER
I20260619 04:45:06.754588 642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.755573 649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.755990 649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:06.756494 493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc: Bootstrap starting.
I20260619 04:45:06.757018 642 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:45:06.760272 493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc: Neither blocks nor log segments found. Creating new log.
I20260619 04:45:06.761699 493 log.cc:824] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc: Log is configured to *not* fsync() on all Append() calls
I20260619 04:45:06.766026 493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc: No bootstrap required, opened a new log
I20260619 04:45:06.774536 493 raft_consensus.cc:348] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.774977 493 raft_consensus.cc:729] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 705552ccefaa4f79958ade95b00196cc, State: Initialized, Role: FOLLOWER
I20260619 04:45:06.775511 493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.776580 663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.777307 663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:06.777835 493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:45:06.778383 468 raft_consensus.cc:482] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 04:45:06.778590 468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 0 FOLLOWER]: Advancing to term 1
W20260619 04:45:06.781008 661 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 04:45:06.781219 661 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 04:45:06.782958 468 raft_consensus.cc:504] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.785965 617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "705552ccefaa4f79958ade95b00196cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7444b5f60fee4c069a02c5f52f23e3a1"
I20260619 04:45:06.786656 617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:45:06.771520 575 master_runner.cc:186] Error getting master registration for 127.9.224.126:46375: OK, instance_id { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" instance_seqno: 1781844305585577 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 04:45:06.790427 575 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 04:45:06.790647 468 leader_election.cc:288] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [CANDIDATE]: Term 1 election: Requested vote from peers ecac4b05094e416bb94ed9cb8fd7e0cc (127.9.224.125:37413), 7444b5f60fee4c069a02c5f52f23e3a1 (127.9.224.124:40597)
I20260619 04:45:06.791388 617 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 705552ccefaa4f79958ade95b00196cc in term 1.
I20260619 04:45:06.792117 444 leader_election.cc:302] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 705552ccefaa4f79958ade95b00196cc, 7444b5f60fee4c069a02c5f52f23e3a1; no voters:
I20260619 04:45:06.792706 663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 1 FOLLOWER]: Leader election won for term 1
I20260619 04:45:06.803159 663 raft_consensus.cc:686] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [term 1 LEADER]: Becoming Leader. State: Replica: 705552ccefaa4f79958ade95b00196cc, State: Running, Role: LEADER
I20260619 04:45:06.804019 663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.810065 671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 705552ccefaa4f79958ade95b00196cc. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.810678 671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: This master's current role is: LEADER
I20260619 04:45:06.815196 673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260619 04:45:06.825024 447 tablet.cc:2369] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:45:06.826063 673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 04:45:06.837198 681 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 04:45:06.849290 567 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } attempt: 5
I20260619 04:45:06.851159 617 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [term 1 FOLLOWER]: Refusing update from remote peer 705552ccefaa4f79958ade95b00196cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:45:06.853577 671 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
Jun 19 04:45:06 dist-test-slave-9dgf krb5kdc[413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781844306, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.224.125@KRBTEST.COM for kudu/127.9.224.124@KRBTEST.COM
I20260619 04:45:06.875337 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.851884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58956 (local address 127.9.224.124:40597)
0619 04:45:06.852066 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.852072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.852093 (+ 21us) server_negotiation.cc:407] Connection header received
0619 04:45:06.852159 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.852165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.852254 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.852366 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.853615 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.854901 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.857100 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.857818 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.857957 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.862756 (+ 4799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.862769 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.862775 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.862814 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.868756 (+ 5942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.871213 (+ 2457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.871226 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.871230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.871394 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.872195 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.872202 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.872206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.872583 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.872727 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.874704 (+ 1977us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.874937 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 04:45:06.875938 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.849922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.224.124:40597 (local address 127.0.0.1:58956)
0619 04:45:06.850190 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0619 04:45:06.850212 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 04:45:06.850364 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 04:45:06.852582 (+ 2218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 04:45:06.852588 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 04:45:06.853149 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0619 04:45:06.853383 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.853398 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.855263 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.855270 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.856692 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 04:45:06.856707 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.858242 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.858249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 04:45:06.858488 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.859213 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 04:45:06.859248 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 04:45:06.862180 (+ 2932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 04:45:06.869464 (+ 7284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.869472 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.869476 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.870057 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.871546 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 04:45:06.871552 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 04:45:06.871556 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 04:45:06.871724 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 04:45:06.872803 (+ 1079us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 04:45:06.872808 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 04:45:06.873066 (+ 258us) client_negotiation.cc:769] Sending connection context
0619 04:45:06.873362 (+ 296us) client_negotiation.cc:240] Negotiation successful
0619 04:45:06.873730 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260619 04:45:06.882280 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: Bootstrap starting.
I20260619 04:45:06.888237 567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: Neither blocks nor log segments found. Creating new log.
I20260619 04:45:06.890909 567 log.cc:824] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: Log is configured to *not* fsync() on all Append() calls
W20260619 04:45:06.891825 596 tablet.cc:2369] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 04:45:06.842147 426 master_runner.cc:186] Error getting master registration for 127.9.224.125:37413: OK, instance_id { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" instance_seqno: 1781844306117963 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 04:45:06.897881 426 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 04:45:06.901971 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: No bootstrap required, opened a new log
I20260619 04:45:06.923596 649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 705552ccefaa4f79958ade95b00196cc. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.923949 649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:06.924551 680 mvcc.cc:205] Tried to move back new op lower bound from 7298434280846172160 to 7298434280677232640. Current Snapshot: MvccSnapshot[applied={T|T < 7298434280846172160}]
I20260619 04:45:06.929181 663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.929512 663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: This master's current role is: LEADER
I20260619 04:45:06.934355 685 mvcc.cc:205] Tried to move back new op lower bound from 7298434280846172160 to 7298434280677232640. Current Snapshot: MvccSnapshot[applied={T|T < 7298434280846172160}]
I20260619 04:45:06.935051 649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.935330 649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:06.942412 673 catalog_manager.cc:1347] Generated new cluster ID: f42549a501274d629e34d2c74a44dee8
I20260619 04:45:06.942531 673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 04:45:06.945840 567 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.954370 567 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecac4b05094e416bb94ed9cb8fd7e0cc, State: Initialized, Role: FOLLOWER
I20260619 04:45:06.955193 567 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } }
I20260619 04:45:06.961402 646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.893893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.9.224.126:46375)
0619 04:45:06.894095 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.894101 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.906960 (+ 12859us) server_negotiation.cc:407] Connection header received
0619 04:45:06.913450 (+ 6490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.913458 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.913549 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.913636 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.919106 (+ 5470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.920281 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.934456 (+ 14175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.935161 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.935305 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.950427 (+ 15122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.950434 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.950440 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.950526 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.954430 (+ 3904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.956259 (+ 1829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.956309 (+ 50us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.956314 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.956641 (+ 327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.957566 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.957572 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.957575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.958426 (+ 851us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.959028 (+ 602us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.960133 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.960621 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 04:45:06.965484 673 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 04:45:06.971236 673 catalog_manager.cc:1504] Loading token signing keys...
I20260619 04:45:06.983071 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.907376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.9.224.125:37413)
0619 04:45:06.907617 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.907624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.919535 (+ 11911us) server_negotiation.cc:407] Connection header received
0619 04:45:06.919909 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.919914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.920008 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.920090 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.927133 (+ 7043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.928251 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.939273 (+ 11022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.940050 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.940160 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.974463 (+ 34303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.974471 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.974477 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.974525 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.978623 (+ 4098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.979602 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.979608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.979612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.979806 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.980609 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.980614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.980617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.981010 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.981264 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.981905 (+ 641us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.982359 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 04:45:06.984809 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:06.862512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58970 (local address 127.9.224.124:40597)
0619 04:45:06.887182 (+ 24670us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:06.887189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:06.916993 (+ 29804us) server_negotiation.cc:407] Connection header received
0619 04:45:06.917371 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:06.917377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:06.917495 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:06.917573 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:06.929203 (+ 11630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.930589 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.957209 (+ 26620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:06.957997 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:06.958115 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:06.974495 (+ 16380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 04:45:06.974507 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 04:45:06.974511 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 04:45:06.974552 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 04:45:06.978626 (+ 4074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.980313 (+ 1687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.980320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.980324 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.980530 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 04:45:06.982529 (+ 1999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 04:45:06.982534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 04:45:06.982538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 04:45:06.982897 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 04:45:06.983165 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:06.983820 (+ 655us) server_negotiation.cc:299] Negotiation successful
0619 04:45:06.984081 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24537,"thread_start_us":30886,"threads_started":1}
I20260619 04:45:06.988586 567 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 04:45:06.989641 542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "705552ccefaa4f79958ade95b00196cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc"
I20260619 04:45:06.986162 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:06.990130 542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [term 0 FOLLOWER]: Advancing to term 1
I20260619 04:45:06.993304 542 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 705552ccefaa4f79958ade95b00196cc in term 1.
I20260619 04:45:06.994064 541 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [term 1 FOLLOWER]: Refusing update from remote peer 705552ccefaa4f79958ade95b00196cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 04:45:06.994194 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:06.997769 671 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 04:45:07.004215 673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc: Generated new TSK 0
I20260619 04:45:07.005846 673 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 04:45:07.050487 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 705552ccefaa4f79958ade95b00196cc. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:07.050787 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:07.050683 663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:07.049930 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "705552ccefaa4f79958ade95b00196cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705552ccefaa4f79958ade95b00196cc" member_type: VOTER last_known_addr { host: "127.9.224.126" port: 46375 } } peers { permanent_uuid: "ecac4b05094e416bb94ed9cb8fd7e0cc" member_type: VOTER last_known_addr { host: "127.9.224.125" port: 37413 } } peers { permanent_uuid: "7444b5f60fee4c069a02c5f52f23e3a1" member_type: VOTER last_known_addr { host: "127.9.224.124" port: 40597 } } }
I20260619 04:45:07.050980 663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 705552ccefaa4f79958ade95b00196cc [sys.catalog]: This master's current role is: LEADER
I20260619 04:45:07.050995 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc [sys.catalog]: This master's current role is: FOLLOWER
I20260619 04:45:07.094560 710 catalog_manager.cc:1259] Loaded cluster ID: f42549a501274d629e34d2c74a44dee8
I20260619 04:45:07.094770 710 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: loading cluster ID for follower catalog manager: success
I20260619 04:45:07.098956 710 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: acquiring CA information for follower catalog manager: success
I20260619 04:45:07.101925 710 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecac4b05094e416bb94ed9cb8fd7e0cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 04:45:07.119314 10113 mini_kdc.cc:348] Time spent kdestroy: real 0.101s user 0.000s sys 0.025s
W20260619 04:45:07.179514 646 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.156189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45614 (local address 127.9.224.126:46375)
0619 04:45:07.156432 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.156441 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.177060 (+ 20619us) server_negotiation.cc:407] Connection header received
0619 04:45:07.177329 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.177335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.177454 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.177593 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.179236 (+ 1643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45614: BlockingRecv error: recv got EOF from 127.0.0.1:45614 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260619 04:45:07.180927 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.162379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58980 (local address 127.9.224.124:40597)
0619 04:45:07.162562 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.162572 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.178036 (+ 15464us) server_negotiation.cc:407] Connection header received
0619 04:45:07.179377 (+ 1341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.179383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.179500 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.179583 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.180659 (+ 1076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58980: BlockingRecv error: recv got EOF from 127.0.0.1:58980 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260619 04:45:07.184510 573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.182086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.9.224.125:37413)
0619 04:45:07.182327 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.182333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.182891 (+ 558us) server_negotiation.cc:407] Connection header received
0619 04:45:07.183145 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.183162 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.183252 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.183336 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.184278 (+ 942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58104: BlockingRecv error: recv got EOF from 127.0.0.1:58104 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 04:45:07.236986 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.217757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58106 (local address 127.9.224.125:37413)
0619 04:45:07.217972 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.217982 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.228878 (+ 10896us) server_negotiation.cc:407] Connection header received
0619 04:45:07.229265 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.229272 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.229489 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.229649 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.230457 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.231644 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.233743 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.234476 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.234584 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.235384 (+ 800us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.236126 (+ 742us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.236283 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.236523 (+ 240us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.236619 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260619 04:45:07.280416 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.270336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58992 (local address 127.9.224.124:40597)
0619 04:45:07.270533 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.270540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.278002 (+ 7462us) server_negotiation.cc:407] Connection header received
0619 04:45:07.278696 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.278705 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.278857 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.278947 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.280145 (+ 1198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58992: BlockingRecv error: recv got EOF from 127.0.0.1:58992 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 04:45:07.329886 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.311939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.9.224.125:37413)
0619 04:45:07.312161 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.312168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.322864 (+ 10696us) server_negotiation.cc:407] Connection header received
0619 04:45:07.323410 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.323417 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.323525 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.323592 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.324295 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.325493 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.327550 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.328292 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.328395 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.329011 (+ 616us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.329188 (+ 177us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.329252 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.329485 (+ 233us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.329573 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260619 04:45:07.372967 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.363040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59004 (local address 127.9.224.124:40597)
0619 04:45:07.363283 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.363290 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.370843 (+ 7553us) server_negotiation.cc:407] Connection header received
0619 04:45:07.371417 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.371426 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.371525 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.371599 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.372693 (+ 1094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59004: BlockingRecv error: recv got EOF from 127.0.0.1:59004 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:45:07.409466 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.402021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.9.224.125:37413)
0619 04:45:07.402319 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.402326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.402863 (+ 537us) server_negotiation.cc:407] Connection header received
0619 04:45:07.403072 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.403080 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.403194 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.403315 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.403838 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.405063 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.407179 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.407867 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.408024 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.408538 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.408701 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.408800 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.408979 (+ 179us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.409093 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260619 04:45:07.420256 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.417771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59010 (local address 127.9.224.124:40597)
0619 04:45:07.417958 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.417965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.418594 (+ 629us) server_negotiation.cc:407] Connection header received
0619 04:45:07.418800 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.418810 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.418937 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.419060 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.419987 (+ 927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59010: BlockingRecv error: recv got EOF from 127.0.0.1:59010 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:45:07.440120 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.432564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58124 (local address 127.9.224.125:37413)
0619 04:45:07.432850 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.432857 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.433436 (+ 579us) server_negotiation.cc:407] Connection header received
0619 04:45:07.433663 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.433670 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.433781 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.433886 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.434488 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.435677 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.437813 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.438573 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.438697 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.439274 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.439438 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.439532 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.439715 (+ 183us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.439808 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
W20260619 04:45:07.450068 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.448225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59026 (local address 127.9.224.124:40597)
0619 04:45:07.448518 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.448525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.448548 (+ 23us) server_negotiation.cc:407] Connection header received
0619 04:45:07.448632 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.448638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.448741 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.448868 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.449821 (+ 953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59026: BlockingRecv error: recv got EOF from 127.0.0.1:59026 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
I20260619 04:45:07.471355 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.464257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.9.224.125:37413)
0619 04:45:07.464458 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.464464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.464987 (+ 523us) server_negotiation.cc:407] Connection header received
0619 04:45:07.465193 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.465199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.465291 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.465400 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.465867 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.467118 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.469089 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.469750 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.469873 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.470488 (+ 615us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.470643 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.470731 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.470912 (+ 181us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.471000 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260619 04:45:07.486600 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.484286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59036 (local address 127.9.224.124:40597)
0619 04:45:07.484472 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.484479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.485014 (+ 535us) server_negotiation.cc:407] Connection header received
0619 04:45:07.485204 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.485211 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.485305 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.485410 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.486336 (+ 926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59036: BlockingRecv error: recv got EOF from 127.0.0.1:59036 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 04:45:07.513499 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.506290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58138 (local address 127.9.224.125:37413)
0619 04:45:07.506499 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.506505 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.507053 (+ 548us) server_negotiation.cc:407] Connection header received
0619 04:45:07.507270 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.507276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.507381 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.507496 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.508038 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.509325 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.511307 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.512092 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.512223 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.512747 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.512883 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.512969 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.513148 (+ 179us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.513229 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260619 04:45:07.530268 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.527756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59052 (local address 127.9.224.124:40597)
0619 04:45:07.527925 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.527931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.528469 (+ 538us) server_negotiation.cc:407] Connection header received
0619 04:45:07.528753 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.528759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.528849 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.528917 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.529989 (+ 1072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59052: BlockingRecv error: recv got EOF from 127.0.0.1:59052 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 04:45:07.572546 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.566613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58150 (local address 127.9.224.125:37413)
0619 04:45:07.566848 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.566856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.567246 (+ 390us) server_negotiation.cc:407] Connection header received
0619 04:45:07.567406 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.567412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.567500 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.567616 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.567982 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.569150 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.570505 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.571254 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.571410 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.571754 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.571895 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.572005 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.572100 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.572189 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260619 04:45:07.581406 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.579231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59062 (local address 127.9.224.124:40597)
0619 04:45:07.579458 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.579464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.579871 (+ 407us) server_negotiation.cc:407] Connection header received
0619 04:45:07.580072 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.580077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.580150 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.580231 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.581154 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59062: BlockingRecv error: recv got EOF from 127.0.0.1:59062 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 04:45:07.655118 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.649186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58164 (local address 127.9.224.125:37413)
0619 04:45:07.649397 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.649404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.649798 (+ 394us) server_negotiation.cc:407] Connection header received
0619 04:45:07.649985 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.649991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.650086 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.650208 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.650687 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.651828 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.653152 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.653829 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.653948 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.654315 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.654441 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.654524 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.654667 (+ 143us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.654745 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260619 04:45:07.669354 645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 04:45:07.667131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.9.224.124:40597)
0619 04:45:07.667348 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.667358 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.667801 (+ 443us) server_negotiation.cc:407] Connection header received
0619 04:45:07.667999 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.668005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.668116 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.668220 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 04:45:07.669113 (+ 893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59074: BlockingRecv error: recv got EOF from 127.0.0.1:59074 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:45:07.783301 661 catalog_manager.cc:1259] Loaded cluster ID: f42549a501274d629e34d2c74a44dee8
I20260619 04:45:07.783406 661 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: loading cluster ID for follower catalog manager: success
I20260619 04:45:07.786034 661 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: acquiring CA information for follower catalog manager: success
I20260619 04:45:07.787907 661 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7444b5f60fee4c069a02c5f52f23e3a1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 04:45:07.806546 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.801476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58170 (local address 127.9.224.125:37413)
0619 04:45:07.801674 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.801679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.802093 (+ 414us) server_negotiation.cc:407] Connection header received
0619 04:45:07.802177 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.802182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.802460 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.802557 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.802975 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.803675 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.804991 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.805390 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.805485 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.805865 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.805974 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.806040 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.806175 (+ 135us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.806295 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 04:45:07.818642 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.812528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.9.224.124:40597)
0619 04:45:07.812717 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.812722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.813067 (+ 345us) server_negotiation.cc:407] Connection header received
0619 04:45:07.813218 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.813222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.813397 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.813497 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.813817 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.814610 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.816353 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.816749 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.816843 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.817414 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.817916 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.818061 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.818315 (+ 254us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.818404 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 04:45:07.834658 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.825077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59106 (local address 127.9.224.124:40597)
0619 04:45:07.825399 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.825407 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.828316 (+ 2909us) server_negotiation.cc:407] Connection header received
0619 04:45:07.828542 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.828551 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.828673 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.828787 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.829381 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.830483 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.832558 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.833261 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.833397 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.833919 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.834021 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.834124 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.834270 (+ 146us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.834351 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 04:45:07.836154 814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.825006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45616 (local address 127.9.224.126:46375)
0619 04:45:07.829070 (+ 4064us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.829078 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.829104 (+ 26us) server_negotiation.cc:407] Connection header received
0619 04:45:07.829258 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.829267 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.829536 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.829719 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.830538 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.831689 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.833598 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.834279 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.834392 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.835084 (+ 692us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.835554 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.835670 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.835765 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.835848 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3894,"thread_start_us":3761,"threads_started":1}
I20260619 04:45:07.836642 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 04:45:07.826337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58182 (local address 127.9.224.125:37413)
0619 04:45:07.826563 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0619 04:45:07.826570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 04:45:07.829906 (+ 3336us) server_negotiation.cc:407] Connection header received
0619 04:45:07.830054 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 04:45:07.830061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 04:45:07.830162 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 04:45:07.830313 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 04:45:07.830963 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.831668 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.834261 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 04:45:07.834948 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 04:45:07.835041 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 04:45:07.835646 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 04:45:07.835759 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 04:45:07.835876 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 04:45:07.836298 (+ 422us) server_negotiation.cc:299] Negotiation successful
0619 04:45:07.836382 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 04:45:07.845163 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 426
I20260619 04:45:07.846436 488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:45:07.959082 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 426
I20260619 04:45:07.980592 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 500
I20260619 04:45:07.981724 562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:45:08.088124 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 500
I20260619 04:45:08.109129 10113 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu pid 575
I20260619 04:45:08.110320 637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 04:45:08.218138 10113 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXgzdm0/build/asan/bin/kudu with pid 575
2026-06-19T04:45:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4469 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (8977 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (367364 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST